Database is not available via R3trans, Cannot find startdb, DB startup failed

[former_member564182]

Dear Experts,

I had installed S4HANA IDES 1610, I was working fine but suddenly I am facing an issue, my HANA Database is up and running below is screenshot, but when I run the command startsap all, startsap , startsap r3 and startsap -v s4hana-ides, it give me below error.

s4hana-ides:devadm 60> startsap

Checking HDB Database

Database is not available via R3trans

-------------------------------------------

Cannot find startdb, DB startup failed

please send the tracefile /home/devadm/startsap.trc to support

startsap.trc

s4hana-ides:devadm 75> cat /home/devadm/startsap.trc

Trace of system startup/check of SAP System DEV on Tue Feb 12 17:17:59 PKT 2019

{17:17:59 ## Main() start: @=/usr/sap/DEV/SYS/exe/uc/linuxx86_64/startsap

@(#) $Id: //bas/749_STACK/src/krn/startscripts/startsap#1 $

BASENAME=startsap

{17:17:59 ## check_user() start: @=devadm

}17:17:59 ## check_user() done

#=0

@=

{17:17:59 ## setPlatform() start

PLATFORM=linuxx86_64

}17:17:59 ## setPlatform() done

{17:17:59 ## setPing() start

PING=/bin/ping

}17:17:59 ## setPing() done

{17:17:59 ## setIfconfig() start

IFCONFIG=/sbin/ifconfig

}17:17:59 ## setIfconfig() done

{17:17:59 ## setIp() start

IP=/sbin/ip

}17:17:59 ## setIp() done

{17:17:59 ## setRootDir() start: @=

USR_SAP=/usr/sap

USR_SAP_SID=/usr/sap/DEV

PROFILE_DIR=/usr/sap/DEV/SYS/profile

DIR_LIBRARY=/usr/sap/DEV/SYS/exe/run

}17:17:59 ## setRootDir() done

{17:17:59 ## setDbUser() start: @=

}17:17:59 ## setDbUser() done

{17:17:59 ## setVHostArray() start

_PROFILES=/usr/sap/DEV/SYS/profile/DEV_ASCS01_s4hana-ides /usr/sap/DEV/SYS/profile/DEV_D00_s4hana-ides /usr/sap/DEV/SYS/profile/DEV_D00_s4hana-ides.1 /usr/sap/DEV/SYS/profile/DEV_D00_s4hana-ides.2 /usr/sap/DEV/SYS/profile/DEV_D00_s4hana-ides.3 /usr/sap/DEV/SYS/profile/DEV_D00_s4hana-ides.4 /usr/sap/DEV/SYS/profile/DEV_D00_s4hana-ides.5

_nrProfiles=7

{17:17:59 ## pushVHostsFromProfile() start: @=/usr/sap/DEV/SYS/profile/DEV_ASCS01_s4hana-ides /usr/sap/DEV/SYS/profile/DEV_D00_s4hana-ides /usr/sap/DEV/SYS/profile/DEV_D00_s4hana-ides.1 /usr/sap/DEV/SYS/profile/DEV_D00_s4hana-ides.2 /usr/sap/DEV/SYS/profile/DEV_D00_s4hana-ides.3 /usr/sap/DEV/SYS/profile/DEV_D00_s4hana-ides.4 /usr/sap/DEV/SYS/profile/DEV_D00_s4hana-ides.5

_DUMMY=DEV_ASCS01_s4hana-ides

_VHOST=s4hana-ides

{17:17:59 ## isVHostLocal() start: s4hana-ides

VHOST=s4hana-ides

_IS_LOCAL=1

}17:17:59 ## isVHostLocal() done: 1

_DUMMY=DEV_D00_s4hana-ides

_VHOST=s4hana-ides

{17:17:59 ## isVHostLocal() start: s4hana-ides

VHOST=s4hana-ides

_IS_LOCAL=1

}17:17:59 ## isVHostLocal() done: 1

_DUMMY=DEV_D00_s4hana-ides.1

_VHOST=s4hana-ides.1

{17:17:59 ## isVHostLocal() start: s4hana-ides.1

VHOST=s4hana-ides.1

_IS_LOCAL=0

}17:17:59 ## isVHostLocal() done: 0

_DUMMY=DEV_D00_s4hana-ides.2

_VHOST=s4hana-ides.2

{17:18:00 ## isVHostLocal() start: s4hana-ides.2

VHOST=s4hana-ides.2

_IS_LOCAL=0

}17:18:00 ## isVHostLocal() done: 0

_DUMMY=DEV_D00_s4hana-ides.3

_VHOST=s4hana-ides.3

{17:18:00 ## isVHostLocal() start: s4hana-ides.3

VHOST=s4hana-ides.3

_IS_LOCAL=0

}17:18:00 ## isVHostLocal() done: 0

_DUMMY=DEV_D00_s4hana-ides.4

_VHOST=s4hana-ides.4

{17:18:00 ## isVHostLocal() start: s4hana-ides.4

VHOST=s4hana-ides.4

_IS_LOCAL=0

}17:18:00 ## isVHostLocal() done: 0

_DUMMY=DEV_D00_s4hana-ides.5

_VHOST=s4hana-ides.5

{17:18:00 ## isVHostLocal() start: s4hana-ides.5

VHOST=s4hana-ides.5

_IS_LOCAL=0

}17:18:01 ## isVHostLocal() done: 0

VHOSTS= s4hana-ides

}17:18:01 ## pushVHostsFromProfile() done

VHOSTS= s4hana-ides

}17:18:01 ## setVHostArray() done

{17:18:01 ## set_instance() start

_PROFILES=/usr/sap/DEV/SYS/profile/DEV_SCS??_s4hana-ides

_nrProfiles=1

_Iset_instance=SCS

{17:18:01 ## pushProfiles() start: @=SCS /usr/sap/DEV/SYS/profile/DEV_SCS??_s4hana-ides

_TEMPINST=SCS??

}17:18:01 ## pushProfiles() done

_PROFILES=/usr/sap/DEV/SYS/profile/DEV_ASCS01_s4hana-ides

_nrProfiles=1

_Iset_instance=ASCS

{17:18:01 ## pushProfiles() start: @=ASCS /usr/sap/DEV/SYS/profile/DEV_ASCS01_s4hana-ides

_TEMPINST=ASCS01

{17:18:01 ## setInstanceDo() start: @=ASCS01 /usr/sap/DEV/SYS/profile/DEV_ASCS01_s4hana-ides:

setInstanceDo: INSTascs=ASCS01:

setInstanceDo: PROFILEascs=/usr/sap/DEV/SYS/profile/DEV_ASCS01_s4hana-ides:

setInstanceDo: INST=ASCS01:

setInstanceDo: INSTFOUND=1:

}17:18:01 ## setInstanceDo() done: 1:

}17:18:01 ## pushProfiles() done

_PROFILES=/usr/sap/DEV/SYS/profile/DEV_ERS??_s4hana-ides

_nrProfiles=1

_Iset_instance=ERS

{17:18:01 ## pushProfiles() start: @=ERS /usr/sap/DEV/SYS/profile/DEV_ERS??_s4hana-ides

_TEMPINST=ERS??

}17:18:01 ## pushProfiles() done

_PROFILES=/usr/sap/DEV/SYS/profile/DEV_SMDA??_s4hana-ides

_nrProfiles=1

_Iset_instance=SMDA

{17:18:01 ## pushProfiles() start: @=SMDA /usr/sap/DEV/SYS/profile/DEV_SMDA??_s4hana-ides

_TEMPINST=SMDA??

}17:18:01 ## pushProfiles() done

_PROFILES=/usr/sap/DEV/SYS/profile/DEV_D?*??_s4hana-ides

_nrProfiles=1

_Iset_instance=D?*

{17:18:01 ## pushProfiles() start: @=D?* /usr/sap/DEV/SYS/profile/DEV_D?*??_s4hana-ides

_TEMPINST=D?*??

}17:18:01 ## pushProfiles() done

_PROFILES=/usr/sap/DEV/SYS/profile/DEV_JC??_s4hana-ides

_nrProfiles=1

_Iset_instance=JC

{17:18:01 ## pushProfiles() start: @=JC /usr/sap/DEV/SYS/profile/DEV_JC??_s4hana-ides

_TEMPINST=JC??

}17:18:01 ## pushProfiles() done

_PROFILES=/usr/sap/DEV/SYS/profile/DEV_D00_s4hana-ides

_nrProfiles=1

_Iset_instance=D

{17:18:01 ## pushProfiles() start: @=D /usr/sap/DEV/SYS/profile/DEV_D00_s4hana-ides

_TEMPINST=D00

{17:18:01 ## setInstanceDo() start: @=D00 /usr/sap/DEV/SYS/profile/DEV_D00_s4hana-ides:

setInstanceDo: INSTd=D00:

setInstanceDo: PROFILEd=/usr/sap/DEV/SYS/profile/DEV_D00_s4hana-ides:

setInstanceDo: INST=D00:

setInstanceDo: INSTFOUND=2:

}17:18:01 ## setInstanceDo() done: 2:

}17:18:01 ## pushProfiles() done

_PROFILES=/usr/sap/DEV/SYS/profile/DEV_J??_s4hana-ides

_nrProfiles=1

_Iset_instance=J

{17:18:01 ## pushProfiles() start: @=J /usr/sap/DEV/SYS/profile/DEV_J??_s4hana-ides

_TEMPINST=J??

}17:18:01 ## pushProfiles() done

_PROFILES=/usr/sap/DEV/SYS/profile/DEV_JMS??_s4hana-ides

_nrProfiles=1

_Iset_instance=JMS

{17:18:01 ## pushProfiles() start: @=JMS /usr/sap/DEV/SYS/profile/DEV_JMS??_s4hana-ides

_TEMPINST=JMS??

}17:18:01 ## pushProfiles() done

_PROFILES=/usr/sap/DEV/SYS/profile/DEV_G??_s4hana-ides

_nrProfiles=1

_Iset_instance=G

{17:18:01 ## pushProfiles() start: @=G /usr/sap/DEV/SYS/profile/DEV_G??_s4hana-ides

_TEMPINST=G??

}17:18:01 ## pushProfiles() done

_PROFILES=/usr/sap/DEV/SYS/profile/DEV_TRX??_s4hana-ides

_nrProfiles=1

_Iset_instance=TRX

{17:18:01 ## pushProfiles() start: @=TRX /usr/sap/DEV/SYS/profile/DEV_TRX??_s4hana-ides

_TEMPINST=TRX??

}17:18:01 ## pushProfiles() done

_PROFILES=/usr/sap/DEV/SYS/profile/DEV_W??_s4hana-ides

_nrProfiles=1

_Iset_instance=W

{17:18:02 ## pushProfiles() start: @=W /usr/sap/DEV/SYS/profile/DEV_W??_s4hana-ides

_TEMPINST=W??

}17:18:02 ## pushProfiles() done

_PROFILES=/usr/sap/DEV/SYS/profile/DEV_V??_s4hana-ides

_nrProfiles=1

_Iset_instance=V

{17:18:02 ## pushProfiles() start: @=V /usr/sap/DEV/SYS/profile/DEV_V??_s4hana-ides

_TEMPINST=V??

}17:18:02 ## pushProfiles() done

NINST=

INSTFOUND=2

NINSTFOUND=0

hasABAP=1

hasJava=0

hasSpecial=1

}17:18:02 ## set_instance() done

{17:18:02 ## prepare() start

{17:18:02 ## set_sapdbhost() start

_PROFILE=/usr/sap/DEV/SYS/profile/DEV_D00_s4hana-ides

SAPDBHOST=s4hana-ides

}17:18:02 ## set_sapdbhost() done

{17:18:02 ## set_db_local() start

VHOST=s4hana-ides

set_dblocal: _DB_LOCAL=1

SAPDBHOST=s4hana-ides

}17:18:02 ## set_db_local() done: 1

{17:18:02 ## set_db_sid() start: @=1

DB_SID=HDB

}17:18:02 ## set_db_sid() done

{17:18:02 ## set_db_running() start

Checking HDB Database

{17:18:02 ## getExePath() start: @=R3trans D00

{17:18:02 ## set_path() start: @=/usr/sap/DEV/D00/exe

N_PATH=/usr/sap/DEV/D00/exe

LD_LIBRARY_PATH=/usr/sap/DEV/D00/exe:/usr/sap/DEV/SYS/exe/run:/usr/sap/DEV/SYS/exe/uc/linuxx86_64:/usr/sap/DEV/hdbclient

O_LD_LIBRARY_PATH=/usr/sap/DEV/SYS/exe/run:/usr/sap/DEV/SYS/exe/uc/linuxx86_64:/usr/sap/DEV/hdbclient

}17:18:02 ## set_path() done

_DIR_EXECUTABLE=/usr/sap/DEV/D00/exe

{17:18:02 ## restore_path() start

LD_LBRARY_PATH=/usr/sap/DEV/SYS/exe/run:/usr/sap/DEV/SYS/exe/uc/linuxx86_64:/usr/sap/DEV/hdbclient

}17:18:02 ## restore_path() done

EXEDIR=/usr/sap/DEV/D00/exe

EXECMD=/usr/sap/DEV/D00/exe/R3trans

}17:18:02 ## getExePath() done: 0

DBCONNECT_TEST=/usr/sap/DEV/D00/exe/R3trans -d -w

{17:18:02 ## set_path() start: @=/usr/sap/DEV/D00/exe

N_PATH=/usr/sap/DEV/D00/exe

LD_LIBRARY_PATH=/usr/sap/DEV/D00/exe:/usr/sap/DEV/SYS/exe/run:/usr/sap/DEV/SYS/exe/uc/linuxx86_64:/usr/sap/DEV/hdbclient

O_LD_LIBRARY_PATH=/usr/sap/DEV/SYS/exe/run:/usr/sap/DEV/SYS/exe/uc/linuxx86_64:/usr/sap/DEV/hdbclient

}17:18:02 ## set_path() done

{17:18:02 ## restore_path() start

LD_LBRARY_PATH=/usr/sap/DEV/SYS/exe/run:/usr/sap/DEV/SYS/exe/uc/linuxx86_64:/usr/sap/DEV/hdbclient

}17:18:02 ## restore_path() done

Database is not available via R3trans

DB_RUNNING=0

JDB_RUNNING=

}17:18:02 ## set_db_running() done: 0

{17:18:02 ## set_sapjdbhost() start

SAPJDBHOST=

}17:18:02 ## set_sapjdbhost() done

{17:18:02 ## set_jdb_local() start

VHOST=s4hana-ides

set_jdb_local: _JDB_LOCAL=0

SAPJDBHOST=

}17:18:02 ## set_jdb_local() done: 0

{17:18:02 ## set_jdb_running() start

JDB_RUNNING=0

_INST=

_PROFILE=

SAPSYSTEMNAME=DEV

}17:18:02 ## set_jdb_running() done: 0

}17:18:02 ## prepare() done

DB_LOCAL=1

DB_RUNNING=0

hasABAP=1

hasJava=0

hasSpecial=1

TASK=ALL

{17:18:02 ## Database() start: @=start

{17:18:02 ## getExePath() start: @=startdb

EXEDIR=

EXECMD=

}17:18:02 ## getExePath() done: 1

Cannot find startdb, DB startup failed

Exit code 5

R3trans -d (Trans.log)

s4hana-ides:devadm 80> cat trans.log

4 ETW000 R3trans version 6.26 (release 749 - 22.08.18 - 20:18:08).

4 ETW000 unicode enabled version

4 ETW000 ===============================================

4 ETW000

4 ETW000 date&time : 12.02.2019 - 14:44:53

4 ETW000 control file: <no ctrlfile>

4 ETW000 R3trans was called as follows: R3trans -d

4 ETW000 trace at level 1 opened for a given file pointer

4 ETW000 [ dev trc,00000] Tue Feb 12 14:44:53 2019

4 ETW000 [ dev trc,00000] Loading DB library '/usr/sap/DEV/SYS/exe/run/dbhdbslib.so' ...

4 ETW000 [ dev trc,00000] Library '/usr/sap/DEV/SYS/exe/run/dbhdbslib.so' loaded

4 ETW000 [ dev trc,00000] Version of '/usr/sap/DEV/SYS/exe/run/dbhdbslib.so' is "749.05", patchlevel (0.600)

4 ETW000 [ dev trc,00000] switch DBSL TRACE LEVEL from 3 to 1

4 ETW000 [ dev trc,00000] DBHDBSLIB : version 749.05, patch 0.600 (Make PL 0.600)

4 ETW000 [ dev trc,00000] HDB shared library (dbhdbslib) patchlevels (last 10)

4 ETW000 [ dev trc,00000] (0.600) SAP Support Package Stack Kernel 7.49 Patch Level 600 (note 2690088)

4 ETW000 [ dev trc,00000] (0.523) Check SQL statement in the cancel process (note 2666055)

4 ETW000 [ dev trc,00000] (0.519) Extended DBSL trace (note 2663188)

4 ETW000 [ dev trc,00000] (0.500) SAP Support Package Stack Kernel 7.49 Patch Level 500 (note 2626990)

4 ETW000 [ dev trc,00000] (0.422) dbsl memory management optimized (note 2600632)

4 ETW000 [ dev trc,00000] (0.414) DB4: SQL-913 Locks on SQL Packages in the 749 Kernel (note 2581617)

4 ETW000 [ dev trc,00000] (0.410) Invalid column index at abap itab callback fixed (note 2548665)

4 ETW000 [ dev trc,00000] (0.401) SAP Support Package Stack Kernel 7.49 Patch Level 401 (note 2573063)

4 ETW000 [ dev trc,00000] (0.400) SAP Support Package Stack Kernel 7.49 Patch Level 400 (note 2555639)

4 ETW000 [ dev trc,00000] (0.316) Avoid SQL in signal handler (note 2525673)

4 ETW000 [ dev trc,00000]

4 ETW000 [ dev trc,00000] Loading SQLDBC client runtime (pid=11343)...

4 ETW000 [ dev trc,00000] SQLDBC Module : /usr/sap/DEV/hdbclient/libSQLDBCHDB.so

4 ETW000 [ dev trc,00000] SQLDBC Runtime : libSQLDBCHDB 2.03.134.1546872976

4 ETW000 [ dev trc,00000] SQLDBC client runtime is 2.03.134.1546872976

4 ETW000 [ dev trc,00000] Try to connect via secure store (DEFAULT) on connection 0 ...

4 ETW000 [ dev trc,00000] Attach to HDB : 2.00.033.00.1535711040 (fa/hana2sp03)

4 ETW000 [ dev trc,00000] fa/hana2sp03 : build_weekstone=0000.00.0

4 ETW000 [ dev trc,00000] fa/hana2sp03 : build_time=2018-08-31 12:31:44

4 ETW000 [ dev trc,00000] Database release is HDB 2.00.033.00.1535711040

4 ETW000 [ dev trc,00000] INFO : Database 'HDB/05' instance is running on 's4hana-ides'

4 ETW000 [ dev trc,00000] INFO : Connect to DB as 'SAPABAP1', connection_id=300160

4 ETW000 [ dev trc,00000] INFO : DATA AGING feature is supported by HANA

4 ETW000 [ dev trc,00000] INFO : FDA feature is supported by HANA

4 ETW000 [ dev trc,00000] INFO : FAE with FDA feature is supported by HANA

4 ETW000 [ dev trc,00000] INFO : CACHEDVIEWTS feature is supported by HANA

4 ETW000 [ dev trc,00000] INFO : DEFERRED LOB WRITING is activated

4 ETW000 [ dev trc,00000] DB max. input host variables : 32767

4 ETW000 [ dev trc,00000] DB max. statement length : 1000000000

4 ETW000 [ dev trc,00000] DB max. array size : 100000

4 ETW000 [ dev trc,00000] use decimal precision as length

4 ETW000 [ dev trc,00000] ABAPVARCHARMODE is used

4 ETW000 [ dev trc,00000] use DBSL marker map

4 ETW000 [ dev trc,00000] INFO : DBSL buffer size = 1048576

4 ETW000 [ dev trc,00000] Command info enabled

4 ETW000 [ dev trc,00000] Now I'm connected to HDB

4 ETW000 [ dev trc,00000] 00: s4hana-ides-HDB/05, since=20190212144453, ABAP= <unknown> (0)

4 ETW000 [ dev trc,00000] Connection 0 opened (DBSL handle 0)

4 ETW000 [ dev trc,00000] Tue Feb 12 14:44:54 2019

4 ETW000 [ dev trc,00000] INFO : SAP RELEASE (DB) = 751

4 ETW000 [ dev trc,00000] Tue Feb 12 14:44:55 2019

4 ETW000 [ dev trc,00000] NTAB: ddntt_column_check(no_of_columns = 25): DBSQLTIMESTMP found, COMPCNT found, VERSION found => DDNTT db_structure is 'C'

4 ETW000 [ dev trc,00000] NTAB: unicodelg of executable is 2, unicodelg of SVERS in nametab is 2

4 ETW000 [ dev trc,00000] NTAB: Lock entries before commit is enabled via rsdb/ntab/lock_entries_for_commit profile parameter setting.

4 ETW000 Connected to DBMS = HDB --- SERVER = '' PORT = '' --- SYSTEM = 'DEV'.

4 ETW690 COMMIT "0" "0"

4 ETW000 trace to file pointer closed

4 ETW000 trace at level 1 opened for a given file pointer

4 ETW000

4 ETW000 ================== STEP 1 =====================

4 ETW000 date&time : 12.02.2019 - 14:44:55

4 ETW000 function : CONNECT

4 ETW000 buffersync : YES

4 ETW724 clients : default

4 ETW000 inline stats : YES

4 ETW000 l.s.m. : VECTOR

4 ETW000 allow_rc6 : YES

4 ETW000 purgedocu : YES

4 ETW000 commit : 100000

4 ETW000 table cache : dynamic

4 ETW000

4 ETW000 [ dev trc,00000] Disconnecting from ALL connections:

4 ETW000 [ dev trc,00000] Disconnecting from connection 0 ...

4 ETW000 [ dev trc,00000] Now I'm disconnected from HDB

4 ETW000 [ dev trc,00000] Disconnected from connection 0

4 ETW000 [ dev trc,00000] statistics db_con_commit (com_total=1, com_tx=1)

4 ETW000 [ dev trc,00000] statistics db_con_rollback (roll_total=0, roll_tx=0)

4 ETW000 Disconnected from database.

4 ETW000 End of Transport (0000).

4 ETW000 date&time: 12.02.2019 - 14:44:55

HANA Database Processes

s4hana-ides:/usr/sap/hostctrl/exe # ./sapcontrol -nr 05 -function GetProcessList

12.02.2019 17:28:34

GetProcessList

OK

name, description, dispstatus, textstatus, starttime, elapsedtime, pid

hdbdaemon, HDB Daemon, GREEN, Running, 2019 02 12 15:45:43, 1:42:51, 3755

hdbcompileserver, HDB Compileserver, GREEN, Running, 2019 02 12 15:46:03, 1:42:31, 3947

hdbdiserver, HDB Deployment Infrastructure Server, GREEN, Running, 2019 02 12 15:47:09, 1:41:25, 4331

hdbdiserver, HDB Deployment Infrastructure Server-HDB, GREEN, Running, 2019 02 12 15:47:09, 1:41:25, 4333

hdbindexserver, HDB Indexserver-HDB, GREEN, Running, 2019 02 12 15:46:05, 1:42:29, 3987

hdbnameserver, HDB Nameserver, GREEN, Running, 2019 02 12 15:45:44, 1:42:50, 3773

hdbpreprocessor, HDB Preprocessor, GREEN, Running, 2019 02 12 15:46:03, 1:42:31, 3949

hdbwebdispatcher, HDB Web Dispatcher, GREEN, Running, 2019 02 12 15:47:09, 1:41:25, 4335

hdbxscontroller, HDB XS Controller, GREEN, Running, 2019 02 12 15:47:09, 1:41:25, 4337

hdbxsengine, HDB XSEngine-HDB, GREEN, Running, 2019 02 12 15:46:05, 1:42:29, 3989

hdbxsexecagent, HDB XS Execution Agent, GREEN, Running, 2019 02 12 15:47:09, 1:41:25, 4343

hdbxsuaaserver, HDB XS UAA Server, GREEN, Running, 2019 02 12 15:47:09, 1:41:25, 4345

Regards,

Faheem.

[mahesh_sardesai]

Hi Faheem,

Please su - sidadm and then check
R3trans -d

A file is created trans.log in the directory where this command did run. It will provide details if the user login is an issue.

One of the possible reasons is below command maybe needed to connect with schema user

hdbuserstore SET DEFAULT <new DC hostname><port> ; SAPABAP1 <PASSWORD>