Dispatcher disp+work.exe process starts but dies (Netweaver 2004s , Windows

[Former Member]

Hi all,

I recently installed Netweaver2004s without any issues in a lab/test environment. The system was successfully running for a few weeks but a recently when I try to log on tthe system I get a WSAECONNREFUSED error message

In SAPMMC the MessageServer (msg_server.exe) is green and running, so is the IGS but the Dispatcher (disp+work.EXE) starts (yellow light) and runs for about a minute and then stops.

I have tried the following:

<i>Reboot of server

Restart SAP instance

Pinging host – connection is OK

Checked services – all SAP services are running

Checked entries in hosts/services file

Cleared all event logs including ACEEvent log

Uninstalled and reinstalled all components</i>

I’m not sure what the issue could be everything was running OK, there were no config changes or new applications installed on the server before the issue occurred.

I’m fairly new to SAP Basis and any help will be greatly appreciated !!

I have included the contents of the dispatcher trace and the CPIC trace

Pars

>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>.

*

• LOCATION CPIC (TCP/IP) on local host

• ERROR partner 'mem100:3302' not reached

*

• TIME Sun Jan 15 20:47:00 2006

• RELEASE 700

• COMPONENT NI (network interface)

• VERSION 38

• RC -10

• MODULE nixxi.cpp

• LINE 2736

• DETAIL NiPConnect2

• SYSTEM CALL connect

• ERRNO 10061

• ERRNO TEXT WSAECONNREFUSED: Connection refused

• COUNTER 29

>>>>>>>>>>>>>>>>>>>>>>>>>>>>

Dispatcher trace dev_disp

-

---

trc file: "dev_disp", trc level: 1, release: "700"

-

---

sysno 01

sid MEM

systemid 560 (PC with Windows NT)

relno 7000

patchlevel 0

patchno 33

intno 20050900

make: multithreaded, ASCII

pid 3172

Sun Jan 15 20:33:34 2006

kernel runs with dp version 206(ext=109) (@(#) DPLIB-INT-VERSION-206)

length of sys_adm_ext is 360 bytes

• SWITCH TRC-HIDE on ***

***LOG Q00=> DpSapEnvInit, DPStart (01 3172) [dpxxdisp.c 1226]

shared lib "dw_xml.dll" version 33 successfully loaded

shared lib "dw_xtc.dll" version 33 successfully loaded

shared lib "dw_stl.dll" version 33 successfully loaded

shared lib "dw_gui.dll" version 33 successfully loaded

rdisp/softcancel_sequence : -> 0,5,-1

use internal message server connection to port 3901

Sun Jan 15 20:33:39 2006

• WARNING => DpNetCheck: NiAddrToHost(1.0.0.0) took 5 seconds

***LOG GZZ=> 1 possible network problems detected - check tracefile and adjust the DNS settings [dpxxtool2.c 5213]

MtxInit: 30000 0 0

DpSysAdmExtInit: ABAP is active

DpSysAdmExtInit: VMC (JAVA VM in WP) is not active

DpShMCreate: sizeof(wp_adm) 6160 (880)

DpShMCreate: sizeof(tm_adm) 3351072 (16672)

DpShMCreate: sizeof(wp_ca_adm) 18000 (60)

DpShMCreate: sizeof(appc_ca_adm) 6000 (60)

DpCommTableSize: max/headSize/ftSize/tableSize=500/8/528040/528048

DpShMCreate: sizeof(comm_adm) 528048 (1048)

DpFileTableSize: max/headSize/ftSize/tableSize=0/0/0/0

DpShMCreate: sizeof(file_adm) 0 (72)

DpShMCreate: sizeof(vmc_adm) 0 (1088)

DpShMCreate: sizeof(wall_adm) (22440/34344/56/100)

DpShMCreate: sizeof(gw_adm) 48

DpShMCreate: SHM_DP_ADM_KEY (addr: 05980040, size: 3972824)

DpShMCreate: allocated sys_adm at 05980040

DpShMCreate: allocated wp_adm at 059819C8

DpShMCreate: allocated tm_adm_list at 059831D8

DpShMCreate: allocated tm_adm at 05983208

DpShMCreate: allocated wp_ca_adm at 05CB5428

DpShMCreate: allocated appc_ca_adm at 05CB9A78

DpShMCreate: allocated comm_adm at 05CBB1E8

DpShMCreate: system runs without file table

DpShMCreate: allocated vmc_adm_list at 05D3C098

DpShMCreate: allocated gw_adm at 05D3C0D8

DpShMCreate: system runs without vmc_adm

DpShMCreate: allocated ca_info at 05D3C108

DpShMCreate: allocated wall_adm at 05D3C110

MBUF state OFF

EmInit: MmSetImplementation( 2 ).

MM diagnostic options set: 0

<ES> client 0 initializing ....

<ES> InitFreeList

<ES> block size is 1024 kByte.

Using implementation flat

<EsNT> Memory Reset disabled as NT default

<ES> 511 blocks reserved for free list.

ES initialized.

J2EE server info

start = TRUE

state = STARTED

pid = 3464

argv[0] = C:\usr\sap\MEM\DVEBMGS01\exe\jcontrol.EXE

argv[1] = C:\usr\sap\MEM\DVEBMGS01\exe\jcontrol.EXE

argv[2] = pf=C:\usr\sap\MEM\SYS\profile\MEM_DVEBMGS01_mem100

argv[3] = -DSAPSTART=1

argv[4] = -DCONNECT_PORT=1053

argv[5] = -DSAPSYSTEM=01

argv[6] = -DSAPSYSTEMNAME=MEM

argv[7] = -DSAPMYNAME=mem100_MEM_01

argv[8] = -DSAPPROFILE=C:\usr\sap\MEM\SYS\profile\MEM_DVEBMGS01_mem100

argv[9] = -DFRFC_FALLBACK=ON

argv[10] = -DFRFC_FALLBACK_HOST=localhost

start_lazy = 0

start_control = SAP J2EE startup framework

DpJ2eeStart: j2ee state = STARTED

rdisp/http_min_wait_dia_wp : 1 -> 1

***LOG Q0K=> DpMsAttach, mscon ( mem100) [dpxxdisp.c 11163]

Sun Jan 15 20:33:40 2006

CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.

CCMS: Initalizing shared memory of size 40000000 for monitoring segment.

Sun Jan 15 20:33:41 2006

CCMS: start to initalize 3.X shared alert area (first segment).

DpMsgAdmin: Set release to 7000, patchlevel 0

MBUF state PREPARED

MBUF component UP

DpMBufHwIdSet: set Hardware-ID

***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c 1050]

DpMsgAdmin: Set patchno for this platform to 33

Release check o.K.

DpJ2eeLogin: j2ee state = CONNECTED

Sun Jan 15 20:34:20 2006

• ERROR => W0 (pid 3480) died [dpxxdisp.c 13748]

• ERROR => W1 (pid 3488) died [dpxxdisp.c 13748]

my types changed after wp death/restart 0xbf --> 0xbe

• ERROR => W2 (pid 3496) died [dpxxdisp.c 13748]

my types changed after wp death/restart 0xbe --> 0xbc

• ERROR => W3 (pid 3504) died [dpxxdisp.c 13748]

my types changed after wp death/restart 0xbc --> 0xb8

• ERROR => W4 (pid 3512) died [dpxxdisp.c 13748]

my types changed after wp death/restart 0xb8 --> 0xb0

• ERROR => W5 (pid 3520) died [dpxxdisp.c 13748]

my types changed after wp death/restart 0xb0 --> 0xa0

• ERROR => W6 (pid 3528) died [dpxxdisp.c 13748]

my types changed after wp death/restart 0xa0 --> 0x80

• DP_FATAL_ERROR => DpWPCheck: no more work processes

• DISPATCHER EMERGENCY SHUTDOWN ***

increase tracelevel of WPs

killing W0-3480 (SIGUSR2)

• ERROR => DpWpKill(3480, SIGUSR2) failed [dpxxtool.c 2586]

killing W1-3488 (SIGUSR2)

• ERROR => DpWpKill(3488, SIGUSR2) failed [dpxxtool.c 2586]

killing W2-3496 (SIGUSR2)

• ERROR => DpWpKill(3496, SIGUSR2) failed [dpxxtool.c 2586]

killing W3-3504 (SIGUSR2)

• ERROR => DpWpKill(3504, SIGUSR2) failed [dpxxtool.c 2586]

killing W4-3512 (SIGUSR2)

• ERROR => DpWpKill(3512, SIGUSR2) failed [dpxxtool.c 2586]

killing W5-3520 (SIGUSR2)

• ERROR => DpWpKill(3520, SIGUSR2) failed [dpxxtool.c 2586]

killing W6-3528 (SIGUSR2)

• ERROR => DpWpKill(3528, SIGUSR2) failed [dpxxtool.c 2586]

NiWait: sleep (10000ms) ...

NiISelect: timeout 10000ms

NiISelect: maximum fd=1669

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sun Jan 15 20:34:30 2006

NiISelect: TIMEOUT occured (10000ms)

dump system status

Workprocess Table (long) Sun Jan 15 20:34:30 2006

========================

No Ty. Pid Status Cause Start Err Sem CPU Time Program Cl User Action Table

-

---

0 DIA 3480 Ended no 1 0 0

1 DIA 3488 Ended no 1 0 0

2 UPD 3496 Ended no 1 0 0

3 ENQ 3504 Ended no 1 0 0

4 BTC 3512 Ended no 1 0 0

5 SPO 3520 Ended no 1 0 0

6 UP2 3528 Ended no 1 0 0

Dispatcher Queue Statistics Sun Jan 15 20:34:30 2006

===========================

--------

---

+

---

+

---

+

---

+--

---

+

Typ

now

high

max

writes

reads

--------

---

+

---

+

---

+

---

+--

---

+

NOWP

0

2

2000

6

6

--------

---

+

---

+

---

+

---

+--

---

+

DIA

6

6

2000

6

0

--------

---

+

---

+

---

+

---

+--

---

+

UPD

0

0

2000

0

0

--------

---

+

---

+

---

+

---

+--

---

+

ENQ

0

0

2000

0

0

--------

---

+

---

+

---

+

---

+--

---

+

BTC

0

0

2000

0

0

--------

---

+

---

+

---

+

---

+--

---

+

SPO

0

0

2000

0

0

--------

---

+

---

+

---

+

---

+--

---

+

UP2

0

0

2000

0

0

--------

---

+

---

+

---

+

---

+--

---

+

max_rq_id 12

wake_evt_udp_now 0

wake events total 8, udp 7 ( 87%), shm 1 ( 12%)

since last update total 8, udp 7 ( 87%), shm 1 ( 12%)

Dump of tm_adm structure: Sun Jan 15 20:34:30 2006

=========================

Term uid man user term lastop mod wp ta a/i (modes)

Workprocess Comm. Area Blocks Sun Jan 15 20:34:30 2006

=============================

Slots: 300, Used: 2, Max: 1

--------

---

+

---

+--

---

+

id

owner

pid

eyecatcher

--------

---

+

---

+--

---

+

0	DISPATCHER	-1	WPCAAD000
1	DISPATCHER	-1	WPCAAD001

NiWait: sleep (5000ms) ...

NiISelect: timeout 5000ms

NiISelect: maximum fd=1669

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sun Jan 15 20:34:35 2006

NiISelect: TIMEOUT occured (5000ms)

Shutdown server ...

DpJ2eeDisableRestart

MsIDelService: delete service J2EE for myself

NiBufSend starting

NiIWrite: hdl 3 sent data (wrt=161,pac=1,MESG_IO)

MsINiWrite: sent 161 bytes

send msg (len 110+51) to name MSG_SERVER, type 0, key -

MsSndName: MS_DEL_PROPERTY ok

Send 51 bytes to MSG_SERVER

MS_DEL_PROPERTY : asynchronous call

send MsDelService(J2EE) to msgserver

DpIJ2eeShutdown: send SIGINT to SAP J2EE startup framework (pid=3464)

killing process (3464) (SOFT_KILL)

DpIJ2eeShutdown: j2ee state = SHUTDOWN

NiBufISelUpdate: new MODE -- (r-) for hdl 4 in set0

SiSelNSet: set events of sock 1568 to: ---

NiBufISelRemove: remove hdl 4 from set0

SiSelNRemove: removed sock 1568 (pos=2)

SiSelNRemove: removed sock 1568

NiSelIRemove: removed hdl 4

DpDelSocketInfo: del info for socket 4 (type=8)

NiICloseHandle: shutdown and close hdl 4 / sock 1568

NiBufIClose: clear extension for hdl 4

DpModState: buffer in state MBUF_PREPARED

NiBufSend starting

NiIWrite: hdl 3 sent data (wrt=110,pac=1,MESG_IO)

MsINiWrite: sent 110 bytes

MsIModState: change state to SHUTDOWN

DpModState: change server state from STARTING to SHUTDOWN

Switch off Shared memory profiling

ShmProtect( 57, 3 )

ShmProtect(SHM_PROFILE, SHM_PROT_RW

ShmProtect( 57, 1 )

ShmProtect(SHM_PROFILE, SHM_PROT_RD

DpWakeUpWps: wake up all wp's

Stop work processes

Stop gateway

killing process (3444) (SOFT_KILL)

Stop icman

killing process (3452) (SOFT_KILL)

Terminate gui connections

wait for end of work processes

wait for end of gateway

[DpProcDied] Process lives (PID:3444 HANDLE:1640)

waiting for termination of gateway ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1669

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sun Jan 15 20:34:36 2006

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process died (PID:3444 HANDLE:1640)

wait for end of icman

[DpProcDied] Process lives (PID:3452 HANDLE:1644)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1669

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sun Jan 15 20:34:37 2006

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:3452 HANDLE:1644)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1669

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sun Jan 15 20:34:38 2006

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:3452 HANDLE:1644)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1669

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sun Jan 15 20:34:39 2006

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:3452 HANDLE:1644)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1669

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sun Jan 15 20:34:40 2006

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:3452 HANDLE:1644)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1669

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sun Jan 15 20:34:41 2006

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:3452 HANDLE:1644)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1669

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sun Jan 15 20:34:42 2006

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:3452 HANDLE:1644)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1669

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sun Jan 15 20:34:43 2006

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:3452 HANDLE:1644)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1669

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sun Jan 15 20:34:44 2006

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:3452 HANDLE:1644)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1669

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sun Jan 15 20:34:45 2006

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:3452 HANDLE:1644)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1669

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sun Jan 15 20:34:46 2006

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:3452 HANDLE:1644)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=1669

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sun Jan 15 20:34:47 2006

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process died (PID:3452 HANDLE:1644)

[DpProcDied] Process died (PID:3464 HANDLE:1624)

NiIMyHostName: hostname = 'mem100'

AdGetSelfIdentRecord: > <

AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 4 (AD_STARTSTOP), ser 0, ex 0, errno 0

DpConvertRequest: net size = 189 bytes

NiBufSend starting

NiIWrite: hdl 3 sent data (wrt=562,pac=1,MESG_IO)

MsINiWrite: sent 562 bytes

send msg (len 110+452) to name -, type 4, key -

detach from message server

***LOG Q0M=> DpMsDetach, ms_detach () [dpxxdisp.c 11447]

NiBufSend starting

NiIWrite: hdl 3 sent data (wrt=110,pac=1,MESG_IO)

MsINiWrite: sent 110 bytes

MsIDetach: send logout to msg_server

MsIDetach: call exit function

DpMsShutdownHook called

NiBufISelUpdate: new MODE -- (r-) for hdl 3 in set0

SiSelNSet: set events of sock 1592 to: ---

NiBufISelRemove: remove hdl 3 from set0

SiSelNRemove: removed sock 1592 (pos=3)

SiSelNRemove: removed sock 1592

NiSelIRemove: removed hdl 3

MBUF state OFF

AdGetSelfIdentRecord: > <

AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0

blks_in_queue/wp_ca_blk_no/wp_max_no = 2/300/7

LOCK WP ca_blk 2

make DISP owner of wp_ca_blk 2

DpRqPutIntoQueue: put request into queue (reqtype 1, prio LOW, rq_id 15)

MBUF component DOWN

NiICloseHandle: shutdown and close hdl 3 / sock 1592

NiBufIClose: clear extension for hdl 3

MsIDetach: detach MS-system

cleanup EM

EsCleanup ....

EmCleanup() -> 0

Es2Cleanup: Cleanup ES2

***LOG Q05=> DpHalt, DPStop ( 3172) [dpxxdisp.c 9836]

Good Bye .....

[Former Member]

Probably your datebase is full (file space).

Run DATEBASE MENAGER, connect to NSP and check it. If Yes - click to Data Area in Information and add set properities on DATA0002. Set new Size and confirm.

Should be working.

Good Luck!

B.

[Former Member]

Thank you Fredrico and Adriaan for your help.

Having examined the dev_wo trace, the error was due to a database connection issue. The db environment variables could not be found.

Somehow the db environment variables got deleted when I logged onto the system with <sid>adm rather than Windows 2003 Administrator (used to install the system)

I entered the following system environment variables

DBMS_TYPE, SAPSYSTEMNAME AND SAPLOCCALHOST. Restarted the system and it worked a treat.

Cheers

Pars

[Former Member]

Hi:

Sun Jan 15 20:34:20 2006

• ERROR => W0 (pid 3480) died [dpxxdisp.c 13748]

Please also post the DEV_W0 trace file, so we can understand why is ending abnormally.

Regards,

Federico G. Babelis

NetWeaver Certified Consultant

http://www.gazum.com

[Former Member]

Almost definiteley a network/connection related problem.

First, 'ping mem100' on the application server where you are starting this dispatcher.

If this works fine, then the problem is on the port side of things.

If not, maybe add mem100 to the host file or DNS and check again.

If you can ping it fine you would need to check the ports.

Check that your services file contain the following entries:

sapdp02 3202/tcp

sapgw02 3302/tcp

sapms<SID> 3602/tcp

If the above checks don't help please update the call and we'll try something else.

Also let us know the landscape of the installation (number of instances, distribution of instances across servers)