Can't start the dispatcher

former_member211905 · ‎12-18-2006

Hi,

I'm having problems with starting the dispatcher service. When I restart the sap system in sapmmc, the dispatcher are stopped after 1 minute and turns grey. Then I'm also unable to log into visual admin. Also tried to restart the server, but it doesn't seem to help.

The strange thing is that the system has worked fine for a long time, but suddenly it doesn't. And I've also checked the log files at /work, /dispatcher/log and /server0/log, but these files are not modified in many days when the system was still working.

I'm adding the developer trace of the dispatcher service here:

-

trc file: "dev_disp", trc level: 1, release: "640"

-

Mon Dec 18 15:08:21 2006

kernel runs with dp version 130(ext=102) (@(#) DPLIB-INT-VERSION-130)

length of sys_adm_ext is 312 bytes

sysno 00

sid CM1

systemid 560 (PC with Windows NT)

relno 6400

patchlevel 0

patchno 101

intno 20020600

make: multithreaded, ASCII

pid 4656

***LOG Q00=> DpSapEnvInit, DPStart (00 4656) [dpxxdisp.c 1098]

shared lib "dw_xml.dll" version 101 successfully loaded

shared lib "dw_xtc.dll" version 101 successfully loaded

shared lib "dw_stl.dll" version 101 successfully loaded

shared lib "dw_gui.dll" version 101 successfully loaded

shared lib "dw_mdm.dll" version 101 successfully loaded

Mon Dec 18 15:08:26 2006

WARNING => DpNetCheck: NiAddrToHost(1.0.0.0) took 5 seconds

***LOG GZZ=> 1 possible network problems detected - check tracefile and adjust the DNS settings [dpxxtool2.c 3887]

MtxInit: -2 0 0

DpSysAdmExtInit: ABAP is active

DpShMCreate: sizeof(wp_adm) 14080 (828)

DpShMCreate: sizeof(tm_adm) 2379840 (11840)

DpShMCreate: sizeof(wp_ca_adm) 18000 (60)

DpShMCreate: sizeof(appc_ca_adm) 6000 (60)

DpShMCreate: sizeof(comm_adm) 192000 (384)

DpShMCreate: sizeof(vmc_adm) 0 (364)

DpShMCreate: sizeof(wall_adm) (22440/34344/56/100)

DpShMCreate: SHM_DP_ADM_KEY (addr: 064E0040, size: 2672904)

DpShMCreate: allocated sys_adm at 064E0040

DpShMCreate: allocated wp_adm at 064E17D0

DpShMCreate: allocated tm_adm_list at 064E4ED0

DpShMCreate: allocated tm_adm at 064E4EF8

DpShMCreate: allocated wp_ca_adm at 06729F38

DpShMCreate: allocated appc_ca_adm at 0672E588

DpShMCreate: allocated comm_adm_list at 0672FCF8

DpShMCreate: allocated comm_adm at 0672FD10

DpShMCreate: allocated vmc_adm_list at 0675EB10

DpShMCreate: system runs without vmc_adm

DpShMCreate: allocated ca_info at 0675EB38

DpShMCreate: allocated wall_adm at 0675EB40

MBUF state OFF

EmInit: MmSetImplementation( 2 ).

<ES> client 0 initializing ....

<ES> InitFreeList

<ES> block size is 1024 kByte.

Using implementation flat

<EsNT> Memory Reset disabled as NT default

<ES> 1228 blocks reserved for free list.

ES initialized.

J2EE server info

start = TRUE

state = STARTED

pid = 5212

argv[0] = G:\usr\sap\CM1\DVEBMGS00/j2ee/os_libs/jcontrol.exe

argv[1] = G:\usr\sap\CM1\DVEBMGS00/j2ee/os_libs/jcontrol.exe

argv[2] = pf=G:\usr\sap\CM1\SYS\profile\CM1_DVEBMGS00_hggap07mobbiz

argv[3] = -DSAPSTART=1

argv[4] = -DCONNECT_PORT=4701

argv[5] = -DLISTEN_PORT=4702

argv[6] = -DSAPSYSTEM=00

argv[7] = -DSAPSYSTEMNAME=CM1

argv[8] = -DSAPMYNAME=hggap07mobbiz_CM1_00

argv[9] = -DSAPPROFILE=G:\usr\sap\CM1\SYS\profile\CM1_DVEBMGS00_hggap07mobbiz

argv[10] = -DFRFC_FALLBACK=ON

argv[11] = -DFRFC_FALLBACK_HOST=localhost

start_lazy = 0

start_control = SAP J2EE startup framework

DpJ2eeStart: j2ee state = STARTED

rdisp/http_min_wait_dia_wp : 1 -> 1

***LOG Q0K=> DpMsAttach, mscon ( hggap07mobbiz) [dpxxdisp.c 9819]

Mon Dec 18 15:08:27 2006

CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.

CCMS: Initalizing shared memory of size 40000000 for monitoring segment.

CCMS: start to initalize 3.X shared alert area (first segment).

DpMsgAdmin: Set release to 6400, patchlevel 0

MBUF state PREPARED

MBUF component UP

DpMBufHwIdSet: set Hardware-ID

***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c 1025]

DpMsgAdmin: Set patchno for this platform to 101

Release check o.K.

DpJ2eeLogin: j2ee state = CONNECTED

Mon Dec 18 15:08:34 2006

***LOG Q0I=> NiPRead: recv (10054: WSAECONNRESET: Connection reset by peer) [ninti.c 789]

DpJ2eeMsgProcess: j2ee state = CONNECTED (NIECONN_BROKEN)

DpIJ2eeShutdown: send SIGINT to SAP J2EE startup framework (pid=5212)

ERROR => DpProcKill: kill failed [dpntdisp.c 433]

DpIJ2eeShutdown: j2ee state = SHUTDOWN

***LOG Q0I=> NiPGetHostByName: hostname 'hggap07mobbiz.hda.hydro.com' not found: gethostbyname (11004: WSANO_DATA: Valid name, no data record of requested type) [ninti.c 294]

Mon Dec 18 15:09:06 2006

ERROR => W0 (pid 5288) died [dpxxdisp.c 12270]
ERROR => W1 (pid 952) died [dpxxdisp.c 12270]
ERROR => W2 (pid 4900) died [dpxxdisp.c 12270]
ERROR => W3 (pid 4736) died [dpxxdisp.c 12270]
ERROR => W4 (pid 4824) died [dpxxdisp.c 12270]
ERROR => W5 (pid 5028) died [dpxxdisp.c 12270]

my types changed after wp death/restart 0xbf --> 0xbe

ERROR => W6 (pid 4996) died [dpxxdisp.c 12270]
ERROR => W7 (pid 5300) died [dpxxdisp.c 12270]
ERROR => W8 (pid 5244) died [dpxxdisp.c 12270]
ERROR => W9 (pid 5408) died [dpxxdisp.c 12270]
ERROR => W10 (pid 5260) died [dpxxdisp.c 12270]

my types changed after wp death/restart 0xbe --> 0xbc

ERROR => W11 (pid 5328) died [dpxxdisp.c 12270]

my types changed after wp death/restart 0xbc --> 0xb8

ERROR => W12 (pid 5056) died [dpxxdisp.c 12270]
ERROR => W13 (pid 5264) died [dpxxdisp.c 12270]

my types changed after wp death/restart 0xb8 --> 0xb0

ERROR => W14 (pid 5276) died [dpxxdisp.c 12270]

my types changed after wp death/restart 0xb0 --> 0xa0

ERROR => W15 (pid 5216) died [dpxxdisp.c 12270]
ERROR => W16 (pid 4940) died [dpxxdisp.c 12270]

my types changed after wp death/restart 0xa0 --> 0x80

DP_FATAL_ERROR => DpWPCheck: no more work processes
DISPATCHER EMERGENCY SHUTDOWN ***

increase tracelevel of WPs

killing W0-5288 (SIGUSR2)

ERROR => DpWpKill(5288, SIGUSR2) failed [dpxxtool.c 2494]

killing W1-952 (SIGUSR2)

ERROR => DpWpKill(952, SIGUSR2) failed [dpxxtool.c 2494]

killing W2-4900 (SIGUSR2)

ERROR => DpWpKill(4900, SIGUSR2) failed [dpxxtool.c 2494]

killing W3-4736 (SIGUSR2)

ERROR => DpWpKill(4736, SIGUSR2) failed [dpxxtool.c 2494]

killing W4-4824 (SIGUSR2)

ERROR => DpWpKill(4824, SIGUSR2) failed [dpxxtool.c 2494]

killing W5-5028 (SIGUSR2)

ERROR => DpWpKill(5028, SIGUSR2) failed [dpxxtool.c 2494]

killing W6-4996 (SIGUSR2)

ERROR => DpWpKill(4996, SIGUSR2) failed [dpxxtool.c 2494]

killing W7-5300 (SIGUSR2)

ERROR => DpWpKill(5300, SIGUSR2) failed [dpxxtool.c 2494]

killing W8-5244 (SIGUSR2)

ERROR => DpWpKill(5244, SIGUSR2) failed [dpxxtool.c 2494]

killing W9-5408 (SIGUSR2)

ERROR => DpWpKill(5408, SIGUSR2) failed [dpxxtool.c 2494]

killing W10-5260 (SIGUSR2)

ERROR => DpWpKill(5260, SIGUSR2) failed [dpxxtool.c 2494]

killing W11-5328 (SIGUSR2)

ERROR => DpWpKill(5328, SIGUSR2) failed [dpxxtool.c 2494]

killing W12-5056 (SIGUSR2)

ERROR => DpWpKill(5056, SIGUSR2) failed [dpxxtool.c 2494]

killing W13-5264 (SIGUSR2)

ERROR => DpWpKill(5264, SIGUSR2) failed [dpxxtool.c 2494]

killing W14-5276 (SIGUSR2)

ERROR => DpWpKill(5276, SIGUSR2) failed [dpxxtool.c 2494]

killing W15-5216 (SIGUSR2)

ERROR => DpWpKill(5216, SIGUSR2) failed [dpxxtool.c 2494]

killing W16-4940 (SIGUSR2)

ERROR => DpWpKill(4940, SIGUSR2) failed [dpxxtool.c 2494]

NiWait: sleep (10000 msecs) ...

NiISelect: timeout 10000 ms

NiISelect: maximum fd=381

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Mon Dec 18 15:09:16 2006

NiISelect: TIMEOUT occured (10000 ms)

dump system status

Workprocess Table (long) Mon Dec 18 14:09:16 2006

========================

No Ty. Pid Status Cause Start Err Sem CPU Time Program Cl User Action Table

-

0 DIA 5288 Ended no 1 0 0

1 DIA 952 Ended no 1 0 0

2 DIA 4900 Ended no 1 0 0

3 DIA 4736 Ended no 1 0 0

4 DIA 4824 Ended no 1 0 0

5 DIA 5028 Ended no 1 0 0

6 UPD 4996 Ended no 1 0 0

7 UPD 5300 Ended no 1 0 0

8 UPD 5244 Ended no 1 0 0

9 UPD 5408 Ended no 1 0 0

10 UPD 5260 Ended no 1 0 0

11 ENQ 5328 Ended no 1 0 0

12 BTC 5056 Ended no 1 0 0

13 BTC 5264 Ended no 1 0 0

14 SPO 5276 Ended no 1 0 0

15 UP2 5216 Ended no 1 0 0

16 UP2 4940 Ended no 1 0 0

Dispatcher Queue Statistics Mon Dec 18 14:09:16 2006

===========================

--------

+
+
+
+--

+

Typ

now

high

max

writes

reads

--------

+
+
+
+--

+

NOWP

0

3

2000

10

--------

+
+
+
+--

+

DIA

4

2000

4

0

--------

+
+
+
+--

+

UPD

0

2000

0

--------

+
+
+
+--

+

ENQ

0

2000

0

--------

+
+
+
+--

+

BTC

0

2000

0

--------

+
+
+
+--

+

SPO

0

2000

0

--------

+
+
+
+--

+

UP2

0

2000

0

--------

+
+
+
+--

+

max_rq_id 12

wake_evt_udp_now 0

wake events total 8, udp 7 ( 87%), shm 1 ( 12%)

since last update total 8, udp 7 ( 87%), shm 1 ( 12%)

Dump of tm_adm structure: Mon Dec 18 14:09:16 2006

=========================

Term uid man user term lastop mod wp ta a/i (modes)

Workprocess Comm. Area Blocks Mon Dec 18 14:09:16 2006

=============================

Slots: 300, Used: 1, Max: 0

--------

+
+--

+

id

owner

pid

eyecatcher

--------

+
+--

+

0

DISPATCHER

-1

WPCAAD000

NiWait: sleep (5000 msecs) ...

NiISelect: timeout 5000 ms

NiISelect: maximum fd=381

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Mon Dec 18 15:09:21 2006

NiISelect: TIMEOUT occured (5000 ms)

Shutdown server ...

DpJ2eeDisableRestart

DpModState: buffer in state MBUF_PREPARED

NiBufSend starting

NiIWrite: write 110, 1 packs, MESG_IO, hdl 5, data complete

MsINiWrite: sent 110 bytes

MsIModState: change state to SHUTDOWN

DpModState: change server state from STARTING to SHUTDOWN

Switch off Shared memory profiling

ShmProtect( 57, 3 )

ShmProtect(SHM_PROFILE, SHM_PROT_RW

ShmProtect( 57, 1 )

ShmProtect(SHM_PROFILE, SHM_PROT_RD

DpWakeUpWps: wake up all wp's

Stop work processes...

Stop gateway

killing process (5128) (SOFT_KILL)

Stop icman

killing process (4344) (SOFT_KILL)

Terminate gui connections

[DpProcDied] Process lives (PID:5128 HANDLE:364)

waiting for termination of gateway

NiWait: sleep (1000 msecs) ...

NiISelect: timeout 1000 ms

NiISelect: maximum fd=381

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Mon Dec 18 15:09:22 2006

NiISelect: TIMEOUT occured (1000 ms)

[DpProcDied] Process died (PID:5128 HANDLE:364)

[DpProcDied] Process died (PID:4344 HANDLE:360)

DpHalt: cancel all lcom connections

MPI CancelAll 2 -> 0

MPI DeleteAll 2 -> 0

[DpProcDied] Process died (PID:5212 HANDLE:340)

NiIMyHostName: hostname = 'hggap07mobbiz'

AdGetSelfIdentRecord: > <

AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 4 (AD_STARTSTOP), ser 0, ex 0, errno 0

DpConvertRequest: net size = 163 bytes

NiBufSend starting

NiIWrite: write 562, 1 packs, MESG_IO, hdl 5, data complete

MsINiWrite: sent 562 bytes

send msg (len 110+452) to name -, type 4, key -

detach from message server

***LOG Q0M=> DpMsDetach, ms_detach () [dpxxdisp.c 10045]

NiBufSend starting

NiIWrite: write 110, 1 packs, MESG_IO, hdl 5, data complete

MsINiWrite: sent 110 bytes

MsIDetach: send logout to msg_server

MsIDetach: call exit function

DpMsShutdownHook called

NiSelClear: removed hdl 5 from selectset

MBUF state OFF

AdGetSelfIdentRecord: > <

AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0

blks_in_queue/wp_ca_blk_no/wp_max_no = 1/300/17

LOCK WP ca_blk 1

make DISP owner of wp_ca_blk 1

DpRqPutIntoQueue: put request into queue (reqtype 1, prio LOW, rq_id 18)

MBUF component DOWN

NiBufClose: clear extensions for hdl 5

NiBufSetStat: bufstat of hdl 5 changed from OK to OFF

NiICloseHandle: shutdown and close hdl 5 / socket 268

MsIDetach: detach MS-system

EsCleanup ....

***LOG Q05=> DpHalt, DPStop ( 4656) [dpxxdisp.c 8547]

Good Bye .....

Hope anybody can help me,

Regards

u00D8yvind

Former Member · ‎12-26-2006

can you tell me how to do AV recovery I got same problem when I restarted the services

former_member211905 · ‎12-19-2006

Finally solved this problem, had to do av recover of the oracle database, it wasn't running properly.

Thanks anyway!

Regs

Øyvind

Former Member · ‎12-19-2006

hi

if u have not changed any thing before the problem arises ,then check for archive directory fill level.

sudhakar

Former Member · ‎12-19-2006

Hi,

Most probably th problem with ur hostname..Can u ping hggap07mobbiz.hda.hydro.com

Regards

Umesh K

achim_hauck2 · ‎12-18-2006

I think the problem is the name resolution of 'hggap07mobbiz.hda.hydro.com'.

Have you changed recently the hosts name?

maybe it's too long. I have in mind, the host name is a maximum of 12 or 13 chars.

can you ping 'hggap07mobbiz.hda.hydro.com' ?

kr, achim

Can't start the dispatcher

Accepted Solutions (0)

Answers (5)

Answers (5)

Re: CIG transaction tracker handling

Re Generate Co files and data files

Re: SBPA - How to handle Intermediate Message Even...

Re: Digital Signature on PDF

Re: CIG transaction tracker handling