Message server not coming up , causing JAVA down

[Former Member]

Hello All,

Java stack is not coming up in dual stack (ABAP+JAVA) after kernel and OS upgrade (AIX+Oracle)

Current kernel level 7.21 SP 201 , AIX 6.1 , SAP ECC 6.0 N/W 7.0 SP28

ABAP : 00

SCS :  01

I have switched to IBM JAVA to SAP JVM 4.1

ABAP stack is up, but while starting JAVA its unable to connect to message server

(in dev_jcontrol:  java message server cannot attach to <hostname> / 3901)

When i checked /usr/sap/SID/SCS01/work i see dev_ms is not there but dev_ms.new is created everytime i try to start JAVA

message server is not coming up even i try to start it soley by below command

./ms.sapHD7_SCS01 pf=/sapmnt/HD7/profile/START_SCS01_<hostname>

ERROR log:

cat dev_ms.new

---------------------------------------------------
trc file: "dev_ms.new", trc level: 1, release: "721"
---------------------------------------------------

[Thr 01] Fri Mar 14 11:56:15 2014
[Thr 01] WLM Tag 'HD7/MSG' successfully set for this process
[Thr 01] ms/http_max_clients = 500 -> 500
[Thr 01] MsSSetTrcLog: trc logging active, max size = 52428800 bytes
systemid   324 (IBM RS/6000 with AIX)
relno      7210
patchlevel 0
patchno    136
intno      20020600
make       multithreaded, Unicode, 64 bit, optimized
pid        25297022

[Thr 01] ***LOG Q01=> MsSInit, MSStart (Msg Server 125297022) [msxxserv_mt. 2299]
[Thr 01] SigISetDefaultAction : default handling for signal SIGCHLD
[Thr 01] ***LOG Q0I=> NiIBindSocket: bind (67: Address already in use) [nixxi.cpp 3739]
[Thr 01] *** ERROR => NiIBindSocket: SiBind failed for hdl 17/sock 7
    (SI_EPORT_INUSE/67; I4; ST; 0.0.0.0:3600) [nixxi.cpp    3739]
[Thr 01] *** ERROR => MsSCommInit: NiBufListen(sapmsHD7) (rc=NIESERV_USED) [msxxserv_mt. 12405]
[Thr 01] *** ERROR => MsSInit: MsSCommInit [msxxserv_mt. 2343]
[Thr 01] *** ERROR => MsSInit failed, see dev_ms.new for details
[msxxserv_mt. 7733]
[Thr 01] ***LOG Q02=> MsSHalt, MSStop (Msg Server25297022) [msxxserv_mt. 7792]

Things i have tried so far

1. stopped HD7 , cleaned ipc , ipcs | grep hd7adm didnot show any thing , started HD7, but same issue

2. server reboot , and then tried starting HD7 , same issue JAVA is not able to connect to message server

netstat -a | grep 3901   doesnot give anything

netstat -a | grep 3900

f1000e0000166008 stream      0      0                0 f1000e0000162f80                0                0 /tmp/.sapstream3900

f1000e0008616808 stream      0      0 f1000a01968efc20                0                0                0 /tmp/.sapstream3900

f1000e0008636c08 stream      0      0                0 f1000e0008a9ac80                0                0 /tmp/.sapstream3900

Please help

Regards

Jain Pankaj

[Sriram2009]

Hi Pankaj

1. Restart the full system and then try

2. Kindly refer the SAP Note

Error msg -

[Thr 01] ***LOG Q0I=> NiIBindSocket: bind (67: Address already in use) [nixxi.cpp 3739]

[Thr 01] *** ERROR => NiIBindSocket: SiBind failed for hdl 17/sock 7

    (SI_EPORT_INUSE/67; I4; ST; 0.0.0.0:3600) [nixxi.cpp    3739]

[Thr 01] *** ERROR => MsSCommInit: NiBufListen(sapmsHD7) (rc=NIESERV_USED) [msxxserv_mt. 12405]

1845121 - Address already in use - how to find the process listening on port ...

BR

SS

[former_member185239]

Hi Pankaj,

It is clear in the error message that 3600 is in used

[Thr 01] *** ERROR => NiIBindSocket: SiBind failed for hdl 17/sock 7

    (SI_EPORT_INUSE/67; I4; ST; 0.0.0.0:3600) [nixxi.cpp    3739]

So run the below command

netstat -nap | grep 3600

and kill the corresponding process using the port and then start the system.

With Regards

Ashutosh chaturvedi

[Former Member]

Hi Pankaj,

Please check the following notes:

1898960 - Message Server fails to bind the port after connection error

1872990 - various error messages related to incorrect resolution of localhost

Thanks

Adil

[Reagan]

Hello

Stop the SAP system completely

Clean the shared memory segments.

Kill all processes from the OS level running under hd7adm if there are some.

Delete the stream file under /tmp

Start database and SAP.

Regards

RB