Hi Guys,
We are experiencing a stop in our SAP system dispatcher.
Below are the dev_disp contents:
ERROR => DpProcKill: kill failed [dpntdisp.c 371]
DpIJ2eeShutdown: j2ee state = SHUTDOWN
SiSelNClear: set events of sock 1452 to: ---
SiSelNRemove: removed sock 1452 (pos=2)
SiSelNRemove: removed sock 1452
NiSelIRemove: removed hdl 2
DpDelSocketInfo: del info for socket 2 (type=7)
NiICloseHandle: shutdown and close hdl 2 / sock 1452 - sock -1
DpModState: buffer in state MBUF_PREPARED
NiBufSend starting
NiIWrite: hdl 3 sent data (wrt=110,pac=1,MESG_IO)
MsINiWrite: sent 110 bytes
MsIModState: change state to SHUTDOWN
DpModState: change server state from STARTING to SHUTDOWN
Switch off Shared memory profiling
ShmProtect( 57, 3 )
ShmProtect(SHM_PROFILE, SHM_PROT_RW
ShmProtect( 57, 1 )
ShmProtect(SHM_PROFILE, SHM_PROT_RD
DpWakeUpWps: wake up all wp's
Stop work processes
Stop gateway
killing process (208) (SOFT_KILL)
Stop icman
killing process (4040) (SOFT_KILL)
Terminate gui connections
wait for end of work processes
wait for end of gateway
[DpProcDied] Process lives (PID:208 HANDLE:1460)
waiting for termination of gateway ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:32:01 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process died (PID:208 HANDLE:1460)
wait for end of icman
[DpProcDied] Process lives (PID:4040 HANDLE:1468)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:32:02 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:4040 HANDLE:1468)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:32:03 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:4040 HANDLE:1468)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:32:04 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:4040 HANDLE:1468)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:32:05 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:4040 HANDLE:1468)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:32:06 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:4040 HANDLE:1468)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:32:07 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:4040 HANDLE:1468)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:32:08 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:4040 HANDLE:1468)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:32:09 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:4040 HANDLE:1468)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:32:10 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process lives (PID:4040 HANDLE:1468)
waiting for termination of icman ...
NiWait: sleep (1000ms) ...
NiISelect: timeout 1000ms
NiISelect: maximum fd=1489
NiISelect: read-mask is NULL
NiISelect: write-mask is NULL
Wed Nov 03 10:32:11 2010
NiISelect: TIMEOUT occured (1000ms)
[DpProcDied] Process died (PID:4040 HANDLE:1468)
[DpProcDied] Process died (PID:1204 HANDLE:1444)
DpStartStopMsg: send stop message (myname is >NGD_NGD_00 <)
AdGetSelfIdentRecord: > <
AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 4 (AD_STARTSTOP), ser 0, ex 0, errno 0
DpConvertRequest: net size = 189 bytes
NiBufSend starting
NiIWrite: hdl 3 sent data (wrt=562,pac=1,MESG_IO)
MsINiWrite: sent 562 bytes
send msg (len 110+452) to name -, type 4, key -
DpStartStopMsg: stop msg sent
NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 3
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 3
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 3
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 3
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 3
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 3
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 3 received data (rcd=114,pac=1,MESG_IO)
NiBufIIn: NIBUF len=114
NiBufIIn: packet complete for hdl 3
NiBufReceive starting
MsINiRead: received 114 bytes
MSG received, len 110+4, flag 3, from MSG_SERVER , typ 0, key -
DpHalt: received 4 bytes from message server
NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)
NiBufIIn: NIBUF len=274
NiBufIIn: packet complete for hdl 3
NiBufReceive starting
MsINiRead: received 274 bytes
MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -
DpHalt: received 164 bytes from message server
NiIRead: hdl 3 recv would block (errno=EAGAIN)
NiIRead: read for hdl 3 timed out (0ms)
DpHalt: no more messages from the message server
DpHalt: send keepalive to synchronize with the message server
NiBufSend starting
NiIWrite: hdl 3 sent data (wrt=114,pac=1,MESG_IO)
MsINiWrite: sent 114 bytes
send msg (len 110+4) to name MSG_SERVER, type 0, key -
MsSndName: MS_NOOP ok
Send 4 bytes to MSG_SERVER
NiIRead: hdl 3 recv would block (errno=EAGAIN)
NiIPeek: peek successful for hdl 3 (r)
NiIRead: hdl 3 received data (rcd=114,pac=1,MESG_IO)
NiBufIIn: NIBUF len=114
NiBufIIn: packet complete for hdl 3
NiBufReceive starting
MsINiRead: received 114 bytes
MSG received, len 110+4, flag 3, from MSG_SERVER , typ 0, key -
Received 4 bytes from MSG_SERVER
Received opcode MS_NOOP from msg_server, reply MSOP_OK
MsOpReceive: ok
MsSendKeepalive : keepalive sent to message server
NiIRead: hdl 3 recv would block (errno=EAGAIN)
Wed Nov 03 10:32:12 2010
NiIPeek: peek for hdl 3 timed out (r; 1000ms)
NiIRead: read for hdl 3 timed out (1000ms)
DpHalt: no more messages from the message server
DpHalt: sync with message server o.k.
detach from message server
***LOG Q0M=> DpMsDetach, ms_detach () [dpxxdisp.c 12996]
NiBufSend starting
NiIWrite: hdl 3 sent data (wrt=110,pac=1,MESG_IO)
MsINiWrite: sent 110 bytes
MsIDetach: send logout to msg_server
MsIDetach: call exit function
DpMsShutdownHook called
NiBufISelUpdate: new MODE -- (r-) for hdl 3 in set0
SiSelNSet: set events of sock 1296 to: ---
NiBufISelRemove: remove hdl 3 from set0
SiSelNRemove: removed sock 1296 (pos=3)
SiSelNRemove: removed sock 1296
NiSelIRemove: removed hdl 3
MBUF state OFF
AdGetSelfIdentRecord: > <
AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0
AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0
blks_in_queue/wp_ca_blk_no/wp_max_no = 1/300/35
LOCK WP ca_blk 1
make DISP owner of wp_ca_blk 1
DpSemRq: key: 2, units: 1, timeout: -1
DpSemRel: key: 2, units: 1
DpRqPutIntoQueue: put request into queue (reqtype 1, prio LOW, rq_id 15)
MBUF component DOWN
NiICloseHandle: shutdown and close hdl 3 / sock 1296
NiBufIClose: clear extension for hdl 3
MsIDetach: detach MS-system
cleanup EM
EsCleanup ....
EmCleanup() -> 0
Es2Cleanup: Cleanup ES2
***LOG Q05=> DpHalt, DPStop ( 8104) [dpxxdisp.c 11183]
Would appreciate any help.
Thank You.