Skip to Content
avatar image
Former Member

SAP work Process goes in run state,Users cannot login developer trace paste

Hi team,

We have a system which is at ECC6 release 701 ABAP + java system.

The work process frequently go in run state and since this is an IDES system, I always restart the system.

Please help me since i want tio know the root cause for the same.

The dev trace is as follows, and i beleive its a listener problem by the logs.

kernel runs with dp version 244000(ext=110000) (@(#) DPLIB-INT-VERSION-244000-UC)

length of sys_adm_ext is 576 bytes

  • SWITCH TRC-HIDE on ***

***LOG Q00=> DpSapEnvInit, DPStart (00 199004) [dpxxdisp.c 1287]

shared lib "dw_xml.dll" version 254 successfully loaded

shared lib "dw_xtc.dll" version 254 successfully loaded

shared lib "dw_stl.dll" version 254 successfully loaded

shared lib "dw_gui.dll" version 254 successfully loaded

shared lib "dw_mdm.dll" version 254 successfully loaded

rdisp/softcancel_sequence : -> 0,5,-1

use internal message server connection to port 3900

Mon Dec 13 08:26:23 2010

  • WARNING => DpNetCheck: NiHostToAddr(www.doesnotexist0223.qqq.nxst) took 6 seconds

<EsNT> Using memory model view.

<EsNT> Memory Reset disabled as NT default

<ES> 127 blocks reserved for free list.

ES initialized.

mm.dump: set maximum dump mem to 96 MB

Mon Dec 13 08:26:29 2010

J2EE server info

start = TRUE

state = STARTED

pid = 200040

argv[0] = D:\usr\sap\BI7\DVEBMGS00\exe\jcontrol.EXE

argv[1] = D:\usr\sap\BI7\DVEBMGS00\exe\jcontrol.EXE

argv[2] = pf=D:\usr\sap\BI7\SYS\profile\BI7_DVEBMGS00_q4de3gsy203

argv[3] = -DSAPSTART=1

argv[4] = -DCONNECT_PORT=65000

argv[5] = -DSAPSYSTEM=00

argv[6] = -DSAPSYSTEMNAME=BI7

argv[7] = -DSAPMYNAME=q4de3gsy203_BI7_00

argv[8] = -DSAPPROFILE=D:\usr\sap\BI7\SYS\profile\BI7_DVEBMGS00_q4de3gsy203

argv[9] = -DFRFC_FALLBACK=ON

argv[10] = -DFRFC_FALLBACK_HOST=localhost

start_lazy = 0

start_control = SAP J2EE startup framework

DpJ2eeStart: j2ee state = STARTED

rdisp/http_min_wait_dia_wp : 1 -> 1

***LOG CPS=> DpLoopInit, ICU ( 3.0 3.0 4.0.1) [dpxxdisp.c 1694]

***LOG Q0K=> DpMsAttach, mscon ( q4de3gsy203) [dpxxdisp.c 12697]

DpStartStopMsg: send start message (myname is >q4de3gsy203_BI7_00 <)

DpStartStopMsg: start msg sent

CCMS: AlInitGlobals : alert/use_sema_lock = TRUE.

CCMS: start to initalize 3.X shared alert area (first segment).

DpMsgAdmin: Set release to 7000, patchlevel 0

MBUF state PREPARED

MBUF component UP

DpMBufHwIdSet: set Hardware-ID

***LOG Q1C=> DpMBufHwIdSet [dpxxmbuf.c 1050]

DpMsgAdmin: Set patchno for this platform to 254

Release check o.K.

DpJ2eeLogin: j2ee state = CONNECTED

Mon Dec 13 08:27:09 2010

my types changed after wp death/restart 0xbf --> 0xbd

my types changed after wp death/restart 0xbd --> 0xb5

my types changed after wp death/restart 0xb5 --> 0x95

Mon Dec 13 08:27:29 2010

  • ERROR => DpWPCheck: W1 (pid 199044) died (severity=0, status=0) [dpxxdisp.c 15841]

  • ERROR => DpWPCheck: W4 (pid 199912) died (severity=0, status=0) [dpxxdisp.c 15841]

  • ERROR => DpWPCheck: W6 (pid 192420) died (severity=0, status=0) [dpxxdisp.c 15841]

  • ERROR => DpWPCheck: W8 (pid 199528) died (severity=0, status=0) [dpxxdisp.c 15841]

  • ERROR => DpWPCheck: W9 (pid 198860) died (severity=0, status=0) [dpxxdisp.c 15841]

  • ERROR => DpWPCheck: W10 (pid 199664) died (severity=0, status=0) [dpxxdisp.c 15841]

my types changed after wp death/restart 0x95 --> 0x85

  • ERROR => DpWPCheck: W12 (pid 200036) died (severity=0, status=0) [dpxxdisp.c 15841]

Mon Dec 13 08:27:43 2010

***LOG Q0I=> NiIRead: recv (10054: WSAECONNRESET: Connection reset by peer) [nixxi.cpp 4424]

  • ERROR => NiIRead: SiRecv failed for hdl 6 / sock 316

(SI_ECONN_BROKEN/10054; I4; ST; 127.0.0.1:4882) [nixxi.cpp 4424]

  • ERROR => DpJ2eeMsgProcess: NiRead failed (NIECONN_BROKEN) [dpxxj2ee.c 1212]

DpJ2eeMsgProcess: j2ee state = CONNECTED (NIECONN_BROKEN)

Mon Dec 13 08:27:49 2010

  • ERROR => DpWPCheck: W0 (pid 200632) died (severity=0, status=0) [dpxxdisp.c 15841]

  • ERROR => DpWPCheck: W1 (pid 199044) died (severity=0, status=0) [dpxxdisp.c 15841]

my types changed after wp death/restart 0x85 --> 0x84

  • ERROR => DpWPCheck: W3 (pid 93796) died (severity=0, status=0) [dpxxdisp.c 15841]

  • ERROR => DpWPCheck: W4 (pid 199912) died (severity=0, status=0) [dpxxdisp.c 15841]

  • ERROR => DpWPCheck: W5 (pid 200484) died (severity=0, status=0) [dpxxdisp.c 15841]

  • ERROR => DpWPCheck: W6 (pid 192420) died (severity=0, status=0) [dpxxdisp.c 15841]

my types changed after wp death/restart 0x84 --> 0x80

  • ERROR => DpWPCheck: W8 (pid 199528) died (severity=0, status=0) [dpxxdisp.c 15841]

  • ERROR => DpWPCheck: W9 (pid 198860) died (severity=0, status=0) [dpxxdisp.c 15841]

  • ERROR => DpWPCheck: W10 (pid 199664) died (severity=0, status=0) [dpxxdisp.c 15841]

  • ERROR => DpWPCheck: W11 (pid 199720) died (severity=0, status=0) [dpxxdisp.c 15841]

  • ERROR => DpWPCheck: W12 (pid 200036) died (severity=0, status=0) [dpxxdisp.c 15841]

  • DP_FATAL_ERROR => DpWPCheck: no more work processes

  • DISPATCHER EMERGENCY SHUTDOWN ***

increase tracelevel of WPs

NiWait: sleep (10000ms) ...

NiISelect: timeout 10000ms

NiISelect: maximum fd=493

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Mon Dec 13 08:27:59 2010

NiISelect: TIMEOUT occured (10000ms)

dump system status

Workprocess Table (long) Mon Dec 13 07:27:59 2010

========================

No Ty. Pid Status Cause Start Err Sem CPU Time Program Cl User Action Table

-


0 DIA 200632 Ended no 2 0 0

1 DIA 199044 Ended no 3 0 0

2 DIA 200280 Ended no 1 0 0

3 DIA 93796 Ended no 2 0 0

4 DIA 199912 Ended no 3 0 0

5 DIA 200484 Ended no 2 0 0

6 UPD 192420 Ended no 3 0 0

7 ENQ 199792 Ended no 1 0 0

8 BTC 199528 Ended no 3 0 0

9 BTC 198860 Ended no 3 0 0

10 BTC 199664 Ended no 3 0 0

11 SPO 199720 Ended no 2 0 0

12 UP2 200036 Ended no 3 0 0

Dispatcher Queue Statistics Mon Dec 13 07:27:59 2010

Switch off Shared memory profiling

ShmProtect( 57, 3 )

ShmProtect(SHM_PROFILE, SHM_PROT_RW

ShmProtect( 57, 1 )

ShmProtect(SHM_PROFILE, SHM_PROT_RD

DpWakeUpWps: wake up all wp's

Stop work processes

Stop gateway

killing process (184860) (SOFT_KILL)

Stop icman

killing process (190124) (SOFT_KILL)

Terminate gui connections

wait for end of work processes

wait for end of gateway

[DpProcDied] Process lives (PID:184860 HANDLE:440)

waiting for termination of gateway ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=493

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Mon Dec 13 08:28:05 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process died (PID:184860 HANDLE:440)

wait for end of icman

[DpProcDied] Process lives (PID:190124 HANDLE:448)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=493

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Mon Dec 13 08:28:06 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:190124 HANDLE:448)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=493

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Mon Dec 13 08:28:07 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:190124 HANDLE:448)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=493

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Mon Dec 13 08:28:08 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process lives (PID:190124 HANDLE:448)

waiting for termination of icman ...

NiWait: sleep (1000ms) ...

NiISelect: timeout 1000ms

NiISelect: maximum fd=493

NiISelect: read-mask is NULL

NiISelect: write-mask is NULL

Mon Dec 13 08:28:09 2010

NiISelect: TIMEOUT occured (1000ms)

[DpProcDied] Process died (PID:190124 HANDLE:448)

[DpProcDied] Process died (PID:200040 HANDLE:424)

DpStartStopMsg: send stop message (myname is >q4de3gsy203_BI7_00 <)

AdGetSelfIdentRecord: > <

AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 4 (AD_STARTSTOP), ser 0, ex 0, errno 0

DpConvertRequest: net size = 189 bytes

NiBufSend starting

NiIWrite: hdl 3 sent data (wrt=562,pac=1,MESG_IO)

MsINiWrite: sent 562 bytes

send msg (len 110+452) to name -, type 4, key -

DpStartStopMsg: stop msg sent

NiIRead: hdl 3 received data (rcd=274,pac=1,MESG_IO)

server

NiIRead: hdl 3 recv would block (errno=EAGAIN)

NiIRead: read for hdl 3 timed out (0ms)

DpHalt: no more messages from the message server

DpHalt: send keepalive to synchronize with the message server

NiBufReceive starting

MsINiRead: received 114 bytes

MSG received, len 110+4, flag 3, from MSG_SERVER , typ 0, key -

Received 4 bytes from MSG_SERVER

Received opcode MS_NOOP from msg_server, reply MSOP_OK

MsOpReceive: ok

MsSendKeepalive : keepalive sent to message server

NiIRead: hdl 3 recv would block (errno=EAGAIN)

Mon Dec 13 08:28:10 2010

NiIPeek: peek for hdl 3 timed out (r; 1000ms)

NiIRead: read for hdl 3 timed out (1000ms)

DpHalt: no more messages from the message server

DpHalt: sync with message server o.k.

detach from message server

***LOG Q0M=> DpMsDetach, ms_detach () [dpxxdisp.c 13043]

NiBufSend starting

NiIWrite: hdl 3 sent data (wrt=110,pac=1,MESG_IO)

MsINiWrite: sent 110 bytes

MsIDetach: send logout to msg_server

MsIDetach: call exit function

DpMsShutdownHook called

NiBufISelUpdate: new MODE -- (r-) for hdl 3 in set0

SiSelNSet: set events of sock 368 to: ---

NiBufISelRemove: remove hdl 3 from set0

SiSelNRemove: removed sock 368 (pos=3)

SiSelNRemove: removed sock 368

NiSelIRemove: removed hdl 3

MBUF state OFF

AdGetSelfIdentRecord: > <

AdCvtRecToExt: opcode 60 (AD_SELFIDENT), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0

AdCvtRecToExt: opcode 40 (AD_MSBUF), ser 0, ex 0, errno 0

blks_in_queue/wp_ca_blk_no/wp_max_no = 1/300/13

LOCK WP ca_blk 1

make DISP owner of wp_ca_blk 1

DpSemRq: key: 2, units: 1, timeout: -1

DpSemRel: key: 2, units: 1

DpRqPutIntoQueue: put request into queue (reqtype 1, prio LOW, rq_id 15)

MBUF component DOWN

NiICloseHandle: shutdown and close hdl 3 / sock 368

NiBufIClose: clear extension for hdl 3

MsIDetach: detach MS-system

cleanup EM

EsCleanup ....

EmCleanup() -> 0

Es2Cleanup: Cleanup ES2

***LOG Q05=> DpHalt, DPStop ( 199004) [dpxxdisp.c 11230]

Good Bye .....

Please revert if you need more information.

Regards,

Prasad Shetty

Add comment
10|10000 characters needed characters exceeded

  • Get RSS Feed

4 Answers

  • Dec 13, 2010 at 09:45 AM

    Can you post the errors in dev_w0?...

    Regards

    Juan

    Add comment
    10|10000 characters needed characters exceeded

    • Former Member Anil Bhandary

      Hi Anil,

      I have upgraded the kernel today since my system got hanged again after backup.

      Lets see what the result is ?,but my Kernel was the latest one n-2.

      Hope this work i saw all my diaolog and spool one in run state .

      How can we see users table etc when all diaolog process in run state we cannot login na .

      Regards,

      Prasad Shetty

  • Dec 20, 2010 at 09:09 AM

    You can check DPmon to see the status of the processes.. If they are all running under SAPSYS, then is most likely an issue with the kernel,

    Note 1153975 - All work processes are used by the user SAPSYS

    Regards

    Juan

    Add comment
    10|10000 characters needed characters exceeded

  • avatar image
    Former Member
    Dec 21, 2010 at 07:46 AM

    Hi,

    I updated the kernel, but still today after backup the system got hung,

    I have seen the dev trace where this is more prominenet please see 0ra 01034 and 27101

    Logon as OPS$-user to get SAPSR3's password

    C Connecting as /@BI7 on connection 0 (nls_hdl 0) ... (dbsl 700 140910)

    C Nls CharacterSet NationalCharSet EnvHp ErrHp ErrHpBatch

    C 0 UTF8 0000000014100910 0000000014108B40 0000000014125368

    C Attaching to DB Server BI7 (con_hdl=0,svchp=0000000014109818,srvhp=0000000014127658)

    C Starting user session: OCISessionBegin(con_hdl=0, usr='/',svchp=0000000014109818, srvhp=0000000014127658, usrhp=0000000014124D68)

    C OCISessionBegin(OCI_DEFAULT) failed with SQL error 1034:

    C ORA-01034: ORACLE not available

    C ORA-27101: shared memory realm does not exist

    C Detaching from DB Server (con_hdl=0,svchp=0000000014109818,srvhp=0000000014127658)

    C *** ERROR => CONNECT failed with sql error '1034'

    [dbsloci.c 11437]

    C SAPUSER or connect error 99=DBSL_ERR_DB, oerr=1034.

    C

    C Mon Dec 20 22:32:25 2010

    C application info callback registered

    C Logon as OPS$-user to get SAPSR3's password

    C Connecting as /@BI7 on connection 0 (nls_hdl 0) ... (dbsl 700 140910)

    C Nls CharacterSet NationalCharSet EnvHp ErrHp ErrHpBatch

    C 0 UTF8 0000000014100910 0000000014108B40 0000000014125368

    C Attaching to DB Server BI7 (con_hdl=0,svchp=0000000014109818,srvhp=0000000014127658)

    C Starting user session: OCISessionBegin(con_hdl=0, usr='/',svchp=0000000014109818, srvhp=0000000014127658, usrhp=0000000014124D68)

    C OCISessionBegin(OCI_DEFAULT) failed with SQL error 1034:

    C ORA-01034: ORACLE not available

    C ORA-27101: shared memory realm does not exist

    C Detaching from DB Server (con_hdl=0,svchp=0000000014109818,srvhp=0000000014127658)

    C *** ERROR => CONNECT failed with sql error '1034'

    [dbsloci.c 11437]

    C SAPUSER or connect error 99=DBSL_ERR_DB, oerr=1034.

    B reconnect failed for connection 0

    M *** ERROR => ThHdlReconnect: db_reconnect failed (2048) [thxxhead.c 17333]

    B

    B Mon Dec 20 22:34:04 2010

    B db_con_reconnect: reconnecting to connection 0:

    B 000: name = R/3, con_id = 000000000, state = DISCONNECTED, tx = NO , hc = NO , perm = YES,

    B reco = YES, frco = NO , timeout = 000, con_max = 255, con_opt = 255, occ = NO

    B opening connection 0 ...

    C application info callback registered

    C Logon as OPS$-user to get SAPSR3's password

    C Connecting as /@BI7 on connection 0 (nls_hdl 0) ... (dbsl 700 140910)

    C Nls CharacterSet NationalCharSet EnvHp

    Please give em the path forward on this.

    Regards,

    Prasad Shetty

    Add comment
    10|10000 characters needed characters exceeded

  • avatar image
    Former Member
    Dec 27, 2010 at 09:57 AM

    Hi Guys,

    The brtools was updated with dbatools 50 and it solved my problem .

    bottom line Brtools had the issue.

    Thanks all for the help which is appreciated by me.

    Regards,

    Prasad Shetty

    Add comment
    10|10000 characters needed characters exceeded

    • Former Member

      does not look like brtool issue, as brtool not require to run SAP and these are database relate and you have issue with SAP application.