Dispatcher not active.

Hi Experts,

Please check this Developer Trace of Dispatcher, this is stopped, when I am restarting my server, it is giving errors :

running but not connected to message server,

and

running but dialog queue standstill, J2EE service unavilable.

-

---

trc file: "dev_disp", trc level: 1, release: "700"

-

---

sysno 01

sid XID

systemid 560 (PC with Windows NT)

relno 7000

patchlevel 0

patchno 52

intno 20050900

make: multithreaded, Unicode, optimized

pid 1412

Fri Sep 21 10:19:59 2007

kernel runs with dp version 210000(ext=109000) (@(#) DPLIB-INT-VERSION-210000-UC)

length of sys_adm_ext is 572 bytes

• SWITCH TRC-HIDE on ***

***LOG Q00=> DpSapEnvInit, DPStart (01 1412) [dpxxdisp.c 1231]

shared lib "dw_xml.dll" version 52 successfully loaded

shared lib "dw_xtc.dll" version 52 successfully loaded

shared lib "dw_stl.dll" version 52 successfully loaded

shared lib "dw_gui.dll" version 52 successfully loaded

rdisp/softcancel_sequence : -> 0,5,-1

use internal message server connection to port 3901

Fri Sep 21 10:20:04 2007

• WARNING => DpNetCheck: NiAddrToHost(1.0.0.0) took 5 seconds

***LOG GZZ=> 1 possible network problems detected - check tracefile and adjust the DNS settings [dpxxtool2.c 5233]

MtxInit: 30000 0 0

DpSysAdmExtInit: ABAP is active

DpSysAdmExtInit: VMC (JAVA VM in WP) is not active

DpIPCInit2: start server >inggnh002sap_XID_01 <

DpShMCreate: sizeof(wp_adm) 12672 (1408)

DpShMCreate: sizeof(tm_adm) 3954072 (19672)

DpShMCreate: sizeof(wp_ca_adm) 24000 (80)

DpShMCreate: sizeof(appc_ca_adm) 8000 (80)

DpCommTableSize: max/headSize/ftSize/tableSize=500/8/528056/528064

DpShMCreate: sizeof(comm_adm) 528064 (1048)

DpFileTableSize: max/headSize/ftSize/tableSize=0/0/0/0

DpShMCreate: sizeof(file_adm) 0 (72)

DpShMCreate: sizeof(vmc_adm) 0 (1452)

DpShMCreate: sizeof(wall_adm) (38456/34360/64/184)

DpShMCreate: sizeof(gw_adm) 48

DpShMCreate: SHM_DP_ADM_KEY (addr: 06510040, size: 4607512)

DpShMCreate: allocated sys_adm at 06510040

DpShMCreate: allocated wp_adm at 06511E28

DpShMCreate: allocated tm_adm_list at 06514FA8

DpShMCreate: allocated tm_adm at 06514FD8

DpShMCreate: allocated wp_ca_adm at 068DA570

DpShMCreate: allocated appc_ca_adm at 068E0330

DpShMCreate: allocated comm_adm at 068E2270

DpShMCreate: system runs without file table

DpShMCreate: allocated vmc_adm_list at 06963130

DpShMCreate: allocated gw_adm at 06963170

DpShMCreate: system runs without vmc_adm

DpShMCreate: allocated ca_info at 069631A0

DpShMCreate: allocated wall_adm at 069631A8

MBUF state OFF

EmInit: MmSetImplementation( 2 ).

MM diagnostic options set: 0

<ES> client 0 initializing ....

<ES> InitFreeList

<ES> block size is 1024 kByte.

Using implementation flat

<EsNT> Memory Reset disabled as NT default

<ES> 511 blocks reserved for free list.

ES initialized.

J2EE server info

start = TRUE

state = STARTED

pid = 1324

argv[0] = D:\usr\sap\XID\DVEBMGS01\exe\jcontrol.EXE

argv[1] = D:\usr\sap\XID\DVEBMGS01\exe\jcontrol.EXE

argv[2] = pf=D:\usr\sap\XID\SYS\profile\XID_DVEBMGS01_inggnh002sap

argv[3] = -DSAPSTART=1

argv[4] = -DCONNECT_PORT=2009

argv[5] = -DSAPSYSTEM=01

argv[6] = -DSAPSYSTEMNAME=XID

argv[7] = -DSAPMYNAME=inggnh002sap_XID_01

argv[8] = -DSAPPROFILE=D:\usr\sap\XID\SYS\profile\XID_DVEBMGS01_inggnh002sap

argv[9] = -DFRFC_FALLBACK=ON

argv[10] = -DFRFC_FALLBACK_HOST=localhost

start_lazy = 0

start_control = SAP J2EE startup framework

DpJ2eeStart: j2ee state = STARTED

rdisp/http_min_wait_dia_wp : 1 -> 1

***LOG CPS=> DpLoopInit, ICU ( 3.0 3.0 4.0.1) [dpxxdisp.c 1617]

Fri Sep 21 10:20:05 2007

***LOG Q0K=> DpMsAttach, mscon ( inggnh002sap) [dpxxdisp.c 11414]

DpStartStopMsg: send start message (myname is >inggnh002sap_XID_01 <)

DpStartStopMsg: start msg sent

CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.

CCMS: Initalizing shared memory of size 60000000 for monitoring segment.

Fri Sep 21 10:20:06 2007

CCMS: start to initalize 3.X shared alert area (first segment).

DpJ2eeLogin: j2ee state = CONNECTED

DpMsgAdmin: Set release to 7000, patchlevel 0

MBUF state PREPARED

MBUF component UP

DpMBufHwIdSet: set Hardware-ID

***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c 1050]

DpMsgAdmin: Set patchno for this platform to 52

Release check o.K.

Fri Sep 21 10:20:41 2007

***LOG Q0I=> NiIRead: recv (10054: WSAECONNRESET: Connection reset by peer) [nixxi.cpp 4235]

• ERROR => NiIRead: SiRecv failed for hdl 4 / sock 1492

(SI_ECONN_BROKEN; I4; ST; 127.0.0.1:2014) [nixxi.cpp 4235]

DpJ2eeMsgProcess: j2ee state = CONNECTED (NIECONN_BROKEN)

DpIJ2eeShutdown: send SIGINT to SAP J2EE startup framework (pid=1324)

• ERROR => DpProcKill: kill failed [dpntdisp.c 371]

DpIJ2eeShutdown: j2ee state = SHUTDOWN

Fri Sep 21 10:20:45 2007

• ERROR => W0 (pid 2804) died [dpxxdisp.c 14021]

• ERROR => W1 (pid 1484) died [dpxxdisp.c 14021]

• ERROR => W2 (pid 2708) died [dpxxdisp.c 14021]

• ERROR => W3 (pid 1464) died [dpxxdisp.c 14021]

my types changed after wp death/restart 0xbf --> 0xbe

• ERROR => W4 (pid 860) died [dpxxdisp.c 14021]

my types changed after wp death/restart 0xbe --> 0xbc

• ERROR => W5 (pid 2964) died [dpxxdisp.c 14021]

my types changed after wp death/restart 0xbc --> 0xb8

• ERROR => W6 (pid 2508) died [dpxxdisp.c 14021]

my types changed after wp death/restart 0xb8 --> 0xb0

• ERROR => W7 (pid 3840) died [dpxxdisp.c 14021]

my types changed after wp death/restart 0xb0 --> 0xa0

• ERROR => W8 (pid 1072) died [dpxxdisp.c 14021]

my types changed after wp death/restart 0xa0 --> 0x80

• DP_FATAL_ERROR => DpWPCheck: no more work processes

• DISPATCHER EMERGENCY SHUTDOWN ***

increase tracelevel of WPs

NiWait: sleep (10000ms) ...

NiISelect: timeout 10000ms

NiISelect: maximum fd=1601

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Sep 21 10:20:55 2007

NiISelect: TIMEOUT occured (10000ms)

dump system status

Workprocess Table (long) Fri Sep 21 04:50:55 2007

========================

No Ty. Pid Status Cause Start Err Sem CPU Time Program Cl User Action Table

-

---

0 DIA 2804 Ended no 1 0 0

1 DIA 1484 Ended no 1 0 0

2 DIA 2708 Ended no 1 0 0

3 DIA 1464 Ended no 1 0 0

4 UPD 860 Ended no 1 0 0

5 ENQ 2964 Ended no 1 0 0

6 BTC 2508 Ended no 1 0 0

7 SPO 3840 Ended no 1 0 0

8 UP2 1072 Ended no 1 0 0

Dispatcher Queue Statistics Fri Sep 21 04:50:55 2007

===========================

--------

---

+

---

+

---

+

---

+ --

---

+

Typ

now

high

max

writes

reads

--------

---

+

---

+

---

+

---

+ --

---

+

NOWP

0

2

2000

6

6

--------

---

+

---

+

---

+

---

+ --

---

+

DIA

5

5

2000

5

0

--------

---

+

---

+

---

+

---

+ --

---

+

UPD

0

0

2000

0

0

--------

---

+

---

+

---

+

---

+ --

---

+

ENQ

0

0

2000

0

0

--------

---

+

---

+

---

+

---

+ --

---

+

BTC

0

0

2000

0

0

--------

---

+

---

+

---

+

---

+ --

---

+

SPO

0

0

2000

0

0

--------

---

+

---

+

---

+

---

+ --

---

+

UP2

0

0

2000

0

0

--------

---

+

---

+

---

+

---

+ --

---

+

max_rq_id 12

wake_evt_udp_now 0

wake events total 8, udp 7 ( 87%), shm 1 ( 12%)

since last update total 8, udp 7 ( 87%), shm 1 ( 12%)

Dump of tm_adm structure: Fri Sep 21 04:50:55 2007

=========================

Term uid man user term lastop mod wp ta a/i (modes)

Workprocess Comm. Area Blocks Fri Sep 21 04:50:55 2007

=============================

Slots: 300, Used: 1, Max: 0

--------

---

+

---

+ --

---

+

id

owner

pid

eyecatcher

--------

---

+

---

+ --

---

+

0

DISPATCHER

-1

WPCAAD000

NiWait: sleep (5000ms) ...

NiISelect: timeout 5000ms

NiISelect: maximum fd=1601

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Sep 21 10:21:00 2007

NiISelect: TIMEOUT occured (5000ms)

DpHalt: shutdown server >inggnh002sap_XID_01 < (normal)

DpJ2eeDisableRestart

DpModState: buffer in state MBUF_PREPARED

NiBufSend starting

NiIWrite: hdl 3 sent data (wrt=110,pac=1,MESG_IO)

MsINiWrite: sent 110 bytes

MsIModState: change state to SHUTDOWN

DpModState: change server state from STARTING to SHUTDOWN

Switch off Shared memory profiling

ShmProtect( 57, 3 )

ShmProtect(SHM_PROFILE, SHM_PROT_RW

ShmProtect( 57, 1 )

ShmProtect(SHM_PROFILE, SHM_PROT_RD

DpWakeUpWps: wake up all wp's

Stop work processes

Stop gateway

killing process (776) (SOFT_KILL)

Stop icman

killing process (2780) (SOFT_KILL)

Terminate gui connections

wait for end of work processes

wait for end of gateway

[DpProcDied] Process lives (PID:776 HANDLE:1572)

waiting for termination of gateway ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1601

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Sep 21 10:21:01 2007

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process died (PID:776 HANDLE:1572)

wait for end of icman

[DpProcDied] Process lives (PID:2780 HANDLE:1576)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1601

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Sep 21 10:21:02 2007

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:2780 HANDLE:1576)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1601

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Sep 21 10:21:03 2007

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:2780 HANDLE:1576)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1601

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Sep 21 10:21:04 2007

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:2780 HANDLE:1576)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1601

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Sep 21 10:21:05 2007

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:2780 HANDLE:1576)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1601

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Sep 21 10:21:06 2007

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:2780 HANDLE:1576)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1601

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Sep 21 10:21:07 2007

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:2780 HANDLE:1576)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1601

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Sep 21 10:21:08 2007

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:2780 HANDLE:1576)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1601

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Sep 21 10:21:09 2007

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:2780 HANDLE:1576)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1601

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Sep 21 10:21:10 2007

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:2780 HANDLE:1576)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1601

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Sep 21 10:21:11 2007

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:2780 HANDLE:1576)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1601

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Fri Sep 21 10:21:12 2007

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process died (PID:2780 HANDLE:1576)

[DpProcDied] Process died (PID:1324 HANDLE:1556)

DpStartStopMsg: send stop message (myname is >inggnh002sap_XID_01 <)

NiIMyHostName: hostname = 'inggnh002sap'

AdGetSelfIdentRecord: > <

AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 4 (AD_STARTSTOP), ser 0, ex 0, errno 0

DpConvertRequest: net size = 189 bytes

NiBufSend starting

NiIWrite: hdl 3 sent data (wrt=562,pac=1,MESG_IO)

MsINiWrite: sent 562 bytes

send msg (len 110+452) to name -, type 4, key -

DpStartStopMsg: stop msg sent

NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 3 recv would block (errno=EAGAIN)

NiIRead: read for hdl 3 timed out (0ms)

DpHalt: no more messages from the message server

DpHalt: send keepalive to synchronize with the message server

NiBufSend starting

NiIWrite: hdl 3 sent data (wrt=114,pac=1,MESG_IO)

MsINiWrite: sent 114 bytes

send msg (len 110+4) to name MSG_SERVER, type 0, key -

MsSndName: MS_NOOP ok

Send 4 bytes to MSG_SERVER

NiIRead: hdl 3 received data (rcd=114,pac=1,MESG_IO)

NiBufIIn: NIBUF len=114

NiBufIIn: packet complete for hdl 3

NiBufReceive starting

MsINiRead: received 114 bytes

MSG received, len 110+4, flag 3, from MSG_SERVER , typ 0, key -

Received 4 bytes from MSG_SERVER

Received opcode MS_NOOP from msg_server, reply MSOP_OK

MsOpReceive: ok

MsSendKeepalive : keepalive sent to message server

NiIRead: hdl 3 recv would block (errno=EAGAIN)

Fri Sep 21 10:21:13 2007

NiIPeek: peek for hdl 3 timed out (r; 1000ms)

NiIRead: read for hdl 3 timed out (1000ms)

DpHalt: no more messages from the message server

DpHalt: sync with message server o.k.

detach from message server

***LOG Q0M=> DpMsDetach, ms_detach () [dpxxdisp.c 11698]

NiBufSend starting

NiIWrite: hdl 3 sent data (wrt=110,pac=1,MESG_IO)

MsINiWrite: sent 110 bytes

MsIDetach: send logout to msg_server

MsIDetach: call exit function

DpMsShutdownHook called

NiBufISelUpdate: new MODE -- (r-) for hdl 3 in set0

SiSelNSet: set events of sock 1516 to: ---

NiBufISelRemove: remove hdl 3 from set0

SiSelNRemove: removed sock 1516 (pos=3)

SiSelNRemove: removed sock 1516

NiSelIRemove: removed hdl 3

MBUF state OFF

AdGetSelfIdentRecord: > <

AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0

blks_in_queue/wp_ca_blk_no/wp_max_no = 1/300/9

LOCK WP ca_blk 1

make DISP owner of wp_ca_blk 1

DpRqPutIntoQueue: put request into queue (reqtype 1, prio LOW, rq_id 15)

MBUF component DOWN

NiICloseHandle: shutdown and close hdl 3 / sock 1516

NiBufIClose: clear extension for hdl 3

MsIDetach: detach MS-system

cleanup EM

EsCleanup ....

EmCleanup() -> 0

Es2Cleanup: Cleanup ES2

***LOG Q05=> DpHalt, DPStop ( 1412) [dpxxdisp.c 10087]

Good Bye .....

Please Help, it is urgent,

Regards,

Study SAP