Former Member

Mar 21, 2010 at 08:18 AM

SAP MMC DISP+wor.exe not running during SGEN was running

93 Views

Dear SDN followers,

Here is the scenirio:

SAP :SAP NW EHP1 in win system

DB: ORACLE 10 in AIX

Distributed Hetrogenous system.

I had run SGEN in 000 client and after 58% completd job monitor, after that the SAP screen got hanged.Then I had stopped SAP instance and when I try to start SAP MMC it starts for 2 mnts and then DISP+work.exe stopped and SAP is not working.I am adding here DEVELOPER TRACE, file.could nt post dev_ms and dev_wo for maxium words limitation in SDN

-

trc file: "dev_disp", trc level: 1, release: "701"

-

sysno 00

sid BWD

systemid 562 (PC with Windows NT)

relno 7010

patchlevel 0

patchno 32

intno 20020600

make: multithreaded, Unicode, 64 bit, optimized

pid 356

Sat Mar 20 18:39:57 2010

kernel runs with dp version 241000(ext=110000) (@(#) DPLIB-INT-VERSION-241000-UC)

length of sys_adm_ext is 576 bytes

SWITCH TRC-HIDE on ***

***LOG Q00=> DpSapEnvInit, DPStart (00 356) [dpxxdisp.c 1286]

shared lib "dw_xml.dll" version 32 successfully loaded

shared lib "dw_xtc.dll" version 32 successfully loaded

shared lib "dw_stl.dll" version 32 successfully loaded

shared lib "dw_gui.dll" version 32 successfully loaded

shared lib "dw_mdm.dll" version 32 successfully loaded

rdisp/softcancel_sequence : -> 0,5,-1

use internal message server connection to port 3900

Sat Mar 20 18:40:03 2010

WARNING => DpNetCheck: NiAddrToHost(1.0.0.0) took 5 seconds

***LOG GZZ=> 1 possible network problems detected - check tracefile and adjust the DNS settings [dpxxtool2.c 5529]

Sat Mar 20 18:40:04 2010

rdisp/queue_size_check_value : -> off

ThTaskStatus: rdisp/reset_online_during_debug 0

EmInit: MmSetImplementation( 2 ).

MM global diagnostic options set: 0

<ES> client 0 initializing ....

<ES> InitFreeList

<ES> block size is 4096 kByte.

<ES> Info: em/initial_size_MB( 12286MB) not multiple of em/blocksize_KB( 4096KB)

<ES> Info: em/initial_size_MB rounded up to 12288MB

Using implementation view

<EsNT> Using memory model view.

<EsNT> Memory Reset disabled as NT default

<ES> 3071 blocks reserved for free list.

ES initialized.

rdisp/http_min_wait_dia_wp : 1 -> 1

***LOG CPS=> DpLoopInit, ICU ( 3.0 3.0 4.0.1) [dpxxdisp.c 1681]

***LOG Q0K=> DpMsAttach, mscon ( SVHQBWD02) [dpxxdisp.c 12483]

DpStartStopMsg: send start message (myname is >SVHQBWD02_BWD_00 <)

DpStartStopMsg: start msg sent

CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.

Sat Mar 20 18:40:05 2010

CCMS: start to initalize 3.X shared alert area (first segment).

DpMsgAdmin: Set release to 7010, patchlevel 0

MBUF state PREPARED

MBUF component UP

DpMBufHwIdSet: set Hardware-ID

***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c 1048]

DpMsgAdmin: Set patchno for this platform to 32

Release check o.K.

Sat Mar 20 18:40:44 2010

my types changed after wp death/restart 0xbf --> 0xbe

my types changed after wp death/restart 0xbe --> 0xbc

my types changed after wp death/restart 0xbc --> 0xb8

my types changed after wp death/restart 0xb8 --> 0xb0

my types changed after wp death/restart 0xb0 --> 0xa0

my types changed after wp death/restart 0xa0 --> 0x80

DP_FATAL_ERROR => DpWPCheck: no more work processes
DISPATCHER EMERGENCY SHUTDOWN ***

increase tracelevel of WPs

NiWait: sleep (10000ms) ...

NiISelect: timeout 10000ms

NiISelect: maximum fd=897

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sat Mar 20 18:40:54 2010

NiISelect: TIMEOUT occured (10000ms)

dump system status

max_rq_id 12

wake_evt_udp_now 0

wake events total 8, udp 6 ( 75%), shm 2 ( 25%)

since last update total 8, udp 6 ( 75%), shm 2 ( 25%)

Dump of tm_adm structure: Sat Mar 20 15:40:54 2010

=========================

Term uid man user term lastop mod wp ta a/i (modes)

Workprocess Comm. Area Blocks Sat Mar 20 15:40:54 2010

=============================

Slots: 300, Used: 1, Max: 0

--------

+
+ --

+

id

owner

pid

eyecatcher

--------

+
+ --

+

0

DISPATCHER

-1

WPCAAD000

NiWait: sleep (5000ms) ...

NiISelect: timeout 5000ms

NiISelect: maximum fd=897

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sat Mar 20 18:40:59 2010

NiISelect: TIMEOUT occured (5000ms)

DpHalt: shutdown server >SVHQBWD02_BWD_00 < (normal)

DpJ2eeDisableRestart

DpModState: buffer in state MBUF_PREPARED

NiBufSend starting

NiIWrite: hdl 2 sent data (wrt=110,pac=1,MESG_IO)

MsINiWrite: sent 110 bytes

MsIModState: change state to SHUTDOWN

DpModState: change server state from STARTING to SHUTDOWN

Switch off Shared memory profiling

ShmProtect( 57, 3 )

ShmProtect(SHM_PROFILE, SHM_PROT_RW

ShmProtect( 57, 1 )

ShmProtect(SHM_PROFILE, SHM_PROT_RD

DpWakeUpWps: wake up all wp's

Stop work processes

Stop gateway

killing process (3508) (SOFT_KILL)

Stop icman

killing process (2884) (SOFT_KILL)

Terminate gui connections

wait for end of work processes

wait for end of gateway

[DpProcDied] Process lives (PID:3508 HANDLE:408)

waiting for termination of gateway ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=897

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sat Mar 20 18:41:00 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process died (PID:3508 HANDLE:408)

wait for end of icman

[DpProcDied] Process lives (PID:2884 HANDLE:572)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=897

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sat Mar 20 18:41:01 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:2884 HANDLE:572)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=897

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sat Mar 20 18:41:02 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:2884 HANDLE:572)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=897

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sat Mar 20 18:41:03 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:2884 HANDLE:572)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=897

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sat Mar 20 18:41:04 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:2884 HANDLE:572)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=897

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sat Mar 20 18:41:05 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:2884 HANDLE:572)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=897

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sat Mar 20 18:41:06 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:2884 HANDLE:572)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=897

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sat Mar 20 18:41:07 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:2884 HANDLE:572)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=897

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sat Mar 20 18:41:08 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:2884 HANDLE:572)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=897

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sat Mar 20 18:41:09 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:2884 HANDLE:572)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=897

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sat Mar 20 18:41:10 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:2884 HANDLE:572)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=897

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Sat Mar 20 18:41:11 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process died (PID:2884 HANDLE:572)

DpStartStopMsg: send stop message (myname is >SVHQBWD02_BWD_00 <)

DpStartStopMsg: Write AD_STARTSTOP message with type= 0, name=SVHQBWD02_BWD_00 , sapsysnr= 0, hostname=SVHQBWD02

AdGetSelfIdentRecord: > <

AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 4 (AD_STARTSTOP), ser 0, ex 0, errno 0

DpConvertRequest: net size = 189 bytes

NiBufSend starting

NiIWrite: hdl 2 sent data (wrt=562,pac=1,MESG_IO)

MsINiWrite: sent 562 bytes

send msg (len 110+452) to name -, type 4, key -

DpStartStopMsg: stop msg sent

NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 2

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 2

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 2

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 2

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 2

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 2

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 2 received data (rcd=274,pac=1,MESG_IO)

NiBufIIn: NIBUF len=274

NiBufIIn: packet complete for hdl 2

NiBufReceive starting

MsINiRead: received 274 bytes

MSG received, len 110+164, flag 1, from MSG_SERVER , typ 0, key -

DpHalt: received 164 bytes from message server

NiIRead: hdl 2 recv would block (errno=EAGAIN)

NiIRead: read for hdl 2 timed out (0ms)

DpHalt: no more messages from the message server

DpHalt: send keepalive to synchronize with the message server

NiBufSend starting

NiIWrite: hdl 2 sent data (wrt=114,pac=1,MESG_IO)

MsINiWrite: sent 114 bytes

send msg (len 110+4) to name MSG_SERVER, type 0, key -

MsSndName: MS_NOOP ok

Send 4 bytes to MSG_SERVER

NiIRead: hdl 2 recv would block (errno=EAGAIN)

NiIPeek: peek successful for hdl 2 (r)

NiIRead: hdl 2 received data (rcd=114,pac=1,MESG_IO)

NiBufIIn: NIBUF len=114

NiBufIIn: packet complete for hdl 2

NiBufReceive starting

MsINiRead: received 114 bytes

MSG received, len 110+4, flag 3, from MSG_SERVER , typ 0, key -

Received 4 bytes from MSG_SERVER

Received opcode MS_NOOP from msg_server, reply MSOP_OK

MsOpReceive: ok

MsSendKeepalive : keepalive sent to message server

NiIRead: hdl 2 recv would block (errno=EAGAIN)

Sat Mar 20 18:41:12 2010

NiIPeek: peek for hdl 2 timed out (r; 1000ms)

NiIRead: read for hdl 2 timed out (1000ms)

DpHalt: no more messages from the message server

DpHalt: sync with message server o.k.

detach from message server

***LOG Q0M=> DpMsDetach, ms_detach () [dpxxdisp.c 12829]

NiBufSend starting

NiIWrite: hdl 2 sent data (wrt=110,pac=1,MESG_IO)

MsINiWrite: sent 110 bytes

MsIDetach: send logout to msg_server

MsIDetach: call exit function

DpMsShutdownHook called

NiBufISelUpdate: new MODE -- (r-) for hdl 2 in set0

SiSelNSet: set events of sock 424 to: ---

NiBufISelRemove: remove hdl 2 from set0

SiSelNRemove: removed sock 424 (pos=2)

SiSelNRemove: removed sock 424

NiSelIRemove: removed hdl 2

MBUF state OFF

AdGetSelfIdentRecord: > <

AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0

blks_in_queue/wp_ca_blk_no/wp_max_no = 1/300/17

LOCK WP ca_blk 1

make DISP owner of wp_ca_blk 1

DpRqPutIntoQueue: put request into queue (reqtype 1, prio LOW, rq_id 15)

MBUF component DOWN

NiICloseHandle: shutdown and close hdl 2 / sock 424

NiBufIClose: clear extension for hdl 2

MsIDetach: detach MS-system

cleanup EM

EsCleanup ....

EmCleanup() -> 0

Es2Cleanup: Cleanup ES2

***LOG Q05=> DpHalt, DPStop ( 356) [dpxxdisp.c 11045]

Good Bye .....

Database: Database error 257 at CON

Database: > ORA-00257: archiver error. Connect internal only, until free

______________________________________________________________________________________________

Please help.

Regards,

Manas