700 Unicode 258 kernel update- Instance does not start

[Former Member]

Hi----

---

I prepared a new kernel (using files in

SAP KERNEL 7.00 64-BIT UNICODE -> Windows Server on x64 64bit) -

---

Sapexe 236 sapexedb 236 dw 258 sapwebdisp 258 igsexe 17.)

-

---

When I start the instance on Windows 2003 Server, the DISP+WORK.exe say 'Running waiting for message server' then goes to 'Stopped. The IGSWD.EXE however goes to green Status "Running". No ABAP WPs have started up.

-

---

The error in the instance work directory is in Stderr1 file-

-

---

Points to a shared memory creation problem - but how can I fix this ?

-

---

• ERROR => [CreateOsShm] CreateFileMapping(37,65 KB) failed with Err=5

ERROR_ACCESS_DENIED: Access is denied. [shmnt.c 2174]

• ERROR => ShmCreate: Create (37,67072,1) failed [shmnt.c 506]

*****************************************************

• Memory diagnostic *

*****************************************************

Systeminformation

-

---

Processor-Typ : Processor-Count : 2

Operating System : NT 5.2, Build 3790

Service Pack : Service Pack 2

-

---

NT Pagefile Informations

-

---

Config. minimum size : 37888000 K

Config. maximum size : 37888000 K

Avail. maximum size : 37888000 K

Num	Pagefile	Min.Size	Max.Size	Avail.Max	Curr.Size
1	c:\pagefile.sys	17408000 K	17408000 K	17408000 K	17408000 K
2	e:\pagefile.sys	20480000 K	20480000 K	20480000 K	20480000 K

-

---

NT Task Manager Informations

-

---

Total Handles : 0

Total Threads : 0

Total Processes : 0

Commit Charge Total : 0 K

Commit Charge Limit : 0 K

Commit Charge Peak : 16 K

Phys.Memory Total : 0 K

Phys.Memory Available : 0 K

File Cache : 0 K

Kernel Memory Total : 0 K

Kernel Memory Paged : 0 K

Kernel Memory Nonpaged : 0 K

-

---

Memory usage of current process

-

---

Total virt.address space : 0000008589934464 K

Avail.virt.address space : 0000008589692256 K

Private Pages : 0 K

Total heap size : 12231 K

Virtual memory regions : 0 K

Uncommitted heap memory : 8164 K

Allocated heap memory : 2611 K

Moveable heap memory : 339 K

DDE shared heap memory : 0 K

-

---

Memory usage of all processes

-

---

PID	Image	Instance	Work.Set	WS Peak	Priv.Pages	PP Peak	Pg Fault
1344	sapstartsrv.exe		18788 K	18788 K	23812 K	23816 K	4
3308	disp+work.EXE		9360 K	9412 K	69620 K	69724 K	2
3304	igswd.EXE		3672 K	3964 K	2904 K	3268 K	1
1324	igsmux.exe		4096 K	4096 K	5952 K	5952 K	1
3256	igspw.exe		3100 K	3100 K	3708 K	3708 K	0
1000	igspw.exe		3100 K	3100 K	3708 K	3708 K	0
	Sum		42116 K		109704 K

CrtOsSemAdm: Can't protect begin page (Ptr=FFFFFFFFFFFFF000,RC=87)

CrtOsSemAdm: Can't protect end page (Ptr=000000000000F000,RC=487)

call semaphore clean-up function ...

***LOG Q0E=> DpSigGenHandler, Exception (c0000005) [dpnttool.c 438]

-

---

C-STACK -

---

SAP (R) - R/3(TM) Callstack, Version 1.0

Copyright (C) SAP AG. All rights reserved.

-

---

Application exception occurred:

Exception : c0000005 (Access Violation)

App : disp+work.EXE (pid=3308)

When : 6/16/2010 23:34:16.631

Threads : 1

-

---

Computer Name : OLTOVMDQ

User Name : SAPSeOAE

-

---

Number of Processors: 2

Processor Type: EM64T Family 6 Model 15 Stepping 11

Windows Version : 5.2 Current Build: 3790

-

---

State Dump for Thread Id cf0

--> (FAULT) Stack Back Trace <--

FramePtr ReturnAd Param#1 Function Name

000000000840fe40 0000000000464b36 0000000000000510 disp+work!SemInit [semnt.c (866)]

000000000840feb0 0000000000430611 ffffffff00000001 disp+work!DpShmPrfCreate [dpxxprf.c (399)]

000000000840fee0 000000000040108d ffffffff00000002 disp+work!DpMain [dpxxdisp.c (1097)]

000000000840ff10 0000000001a5df51 0000000000000000 disp+work!nlsui_main [thxxanf.c (84)]

000000000840ff70 0000000077d5964c 0000000000000000 disp+work!wmainCRTStartup [crtexe.c (498)]

000000000840ffa0 0000000000000000 0000000001a5dde0 kernel32!BaseProcessStart

-

---

-

---

Wed Jun 16 23:34:17 2010

call clean-up function ...

• ERROR => SigICallExitRoutine: not initialized [signt.c 304]

return from clean-up function ...

cheers

Michael

[franz_hiltscher · Accepted solution]

Hi Michael,

if your last kernel update is longer ago this could be the solution.

Note 1375494 - SAP system does not start after applying SAP kernel patch

Kind Regards

Franz

[franz_hiltscher · Accepted solution]

i also can remember that on windows it is a requirement to install a new Visual C++ Redistributable Package.

I cant find the note.

[Former Member · Accepted solution]

Hi Franz, Thanks for the note 1375494 - it is the one mentioning the Visual C++ package. I checked the pdf attached to the note for the errors and when I ran sapntchk.exe (new and older versions) it ran ok without the symptom described. I found that a vcredist_X86 patch was applied in Aug 2009 to the Win 2003 server. I ran the x64 anyway as the application server kernel installed there is X64 unicode 700 (there is also a solution manager Windows system installed on the same server).

The startup still fails in the same way, regards, Michael

[Former Member · Accepted solution]

Hi Franz, Thanks for the note 1375494 - it is the one mentioning the Visual C++ package. I checked the pdf attached to the note for the errors and when I ran sapntchk.exe (new and older versions) it ran ok without the symptom described. I found that a vcredist_X86 patch was applied in Aug 2009 to the Win 2003 server. I ran the x64 anyway as the application server kernel installed there is X64 unicode 700 (there is also a solution manager Windows system installed on the same server).

The startup still fails in the same way, regards, Michael

[Former Member · Accepted solution]

Hi Franz, Thanks for the note 1375494 - it is the one mentioning the Visual C++ package. I checked the pdf attached to the note for the errors and when I ran sapntchk.exe (new and older versions) it ran ok without the symptom described. I found that a vcredist_X86 patch was applied in Aug 2009 to the Win 2003 server. I ran the x64 anyway as the application server kernel installed there is X64 unicode 700 (there is also a solution manager Windows system installed on the same server).

The startup still fails in the same way, regards, Michael

[Former Member]

I looked also at SAP note 1431956 which states-

IBM i 7.1 and Windows 2008 R2 are being certified by SAP to run with the new DBSL-Direct-Drive (XDN). Application servers on these operating system releases will use XDN by default. See note 1257635

I checked the iSeries central instance (patch 258) and it is using XDA which is correct-

C driver = XDA

C Connect type = LOCAL

Just in case, in the instance profile for the Windows D02 instance I added the line

dbs/db4/driver_type = XDA

But when I stopped and started the D02 instance the same errors occurred as previously.

regards,

Michael

[Former Member]

Thanks Franx and John for information regarding the vcredist patch-

the note 1375494 - is the one mentioning the Visual C++ package. I checked the pdf attached to the note for the errors and when I ran sapntchk.exe (new and older versions) it ran ok without the symptom described. I found that a vcredist_X86 patch was applied in Aug 2009 to the Win 2003 server. I ran the x64 anyway as the application server kernel installed there is X64 unicode 700 (there is also a solution manager Windows system installed on the same server).

The startup still fails in the same way, regards, Michael

[former_member189546]

Hello,

Application exception occurred: Exception : c0000005

Is a memory exception with Windows and disp+work

reboot Windows

If issue persists go to a later disp+work patch

regards,

John Feely

[former_member204746]

try this direct link to download a fix:

http://download.microsoft.com/download/6/B/B/6BB661D6-A8AE-4819-B79F-236472F6070C/vcredist_x64.exe

if it does not work:

go at http://www.microsoft.com/downloads/details.aspx?familyid=766a6af7-ec73-40ff-b072-9112bab119c2&displa...

download vcredist_x64.exe

install this fix and your problem will be resolved.

[Former Member]

Thanks John,

re - going to later patch- I wish !

I did prepare the new kernel exe directory with the latest - patch s 258 for DW for 700 Unicode 64 bit Windows Server x64 64 bit.

These are the sar files I used -

SAP KERNEL 7.00 64-BIT UNICODE -> Windows Server on x64 64bit -> #Database independent

SAR SAPEXE_236-20001354.SAR Kernel Part I (for Basis 7.00) 236 Info 212025 25.01.2010

SAR dw_258-20001354.sar disp+work package 258 Info 119877 11.06.2010 <<<<<

SAR sapwebdisp_258-20001354.sar sapwebdisp 258 Info 10497 11.06.2010

SAP KERNEL 7.00 64-BIT UNICODE -> Windows Server on x64 64bit -> DB2/400

SAR SAPEXEDB_236-20001360.SAR Kernel Part II (for Basis 7.00) 236 Info 8793 25.01.2010

SAR lib_dbsl_256-20001360.sar Database Library 256 Info 2098 21.05.2010

regards

Michael

[franz_hiltscher]

Do you try to restore to your old kernel and the error isn't present?

Do you have a DB2 on iSeries as DB Instance?

Kind Regards

Franz

[Former Member]

Thanks Eric, The download was fine, I know now for next Windows server I do battle with.

However problem persists.

Re -the SAPNTCHK.EXE output produced when I ran this command on the Win 2003 server, it did give some errors as follows -

sapntchk.exe

SAPNTCHK for Windows NT (5.0.0.8)

==================================

- Program Arguments ... [OK] ( 0.001 sec)

- System-Informations ... [OK] ( 0.001 sec)

- Server ... [OK] ( 0.261 sec)

- Time Settings ... [OK] ( 0.001 sec)

- Hostname ... [FAIL] ( 0.056 sec) <<<<<<<

- Network Services ... [OK] ( 0.010 sec)

- Networkcards Informations ... [FAIL] ( 0.012 sec) <<<<<<<<<<

- NT Pagefiles ... [OK] ( 0.000 sec)

- NT Shares ... [OK] ( 0.020 sec)

- Disk configuration ... [OK] ( 0.001 sec)

- Dr.Watson ... [FAIL] ( 0.000 sec)

- Registry Informations ... [OK] ( 0.012 sec)

- Service Informations ... [OK] ( 0.014 sec)

- Process Informations ... [OK] ( 0.021 sec)

Configuration check has 2 ERRORS found

please analyse file [SapNtChk.log]

However from command line ping <host> and ping <host>.<domainname> are fine.

When I run this on the Production system Win 2003 server, these steps pass with OK.

The log file produced has this output-

Services

-

---

[ 0] Application Experience Lookup Service [running]

[ 1] Alerter [stopped]

[ 2] Application Layer Gateway Service [stopped]

[ 3] Application Management [stopped]

[ 4] Windows Audio [stopped]

[ 5] Background Intelligent Transfer Service [stopped]

[ 6] Computer Browser [running]

[ 7] Indexing Service [stopped]

[ 8] ClipBook [stopped]

[ 9] COM+ System Application [running]

[ 10] Cryptographic Services [running]

[ 11] System i Access for Windows Remote Comma [stopped]

[ 12] DCOM Server Process Launcher [running]

[ 13] Distributed File System [stopped]

[ 14] DHCP Client [running]

[ 15] Logical Disk Manager Administrative Serv [stopped]

[ 16] Logical Disk Manager [running]

[ 17] DNS Client [running]

[ 18] Error Reporting Service [running]

[ 19] Event Log [running]

[ 20] COM+ Event System [running]

[ 21] Help and Support [running]

[ 22] Human Interface Device Access [stopped]

[ 23] HTTP SSL [stopped]

[ 24] IAS Jet Database Access [stopped]

[ 25] IMAPI CD-Burning COM Service [stopped]

[ 26] Intersite Messaging [stopped]

[ 27] Java Quick Starter [running]

[ 28] Kerberos Key Distribution Center [stopped]

[ 29] Server [running]

[ 30] Workstation [running]

[ 31] License Logging [stopped]

[ 32] TCP/IP NetBIOS Helper [running]

[ 33] Messenger [stopped]

[ 34] NetMeeting Remote Desktop Sharing [stopped]

[ 35] Distributed Transaction Coordinator [running]

[ 36] Windows Installer [stopped]

[ 37] Network DDE [stopped]

[ 38] Network DDE DSDM [stopped]

[ 39] Net Logon [running]

[ 40] Network Connections [running]

[ 41] Network Location Awareness (NLA) [running]

[ 42] File Replication [stopped]

[ 43] NT LM Security Support Provider [stopped]

[ 44] Removable Storage [stopped]

[ 45] Plug and Play [running]

[ 46] IPSEC Services [running]

[ 47] Protected Storage [running]

[ 48] Remote Access Auto Connection Manager [stopped]

[ 49] Remote Access Connection Manager [stopped]

[ 50] Remote Desktop Help Session Manager [stopped]

[ 51] Routing and Remote Access [stopped]

[ 52] Remote Registry [running]

[ 53] Remote Procedure Call (RPC) Locator [stopped]

[ 54] Remote Procedure Call (RPC) [running]

[ 55] Resultant Set of Policy Provider [stopped]

[ 56] Special Administration Console Helper [stopped]

[ 57] Security Accounts Manager [running]

[ 58] MAXDB: .M770432 [stopped]

[ 59] MAXDB: .M770432 (slow) [stopped]

[ 60] SAPDB: OPS [stopped]

[ 61] SAPDB: OPS (quick) [stopped]

[ 62] SAPDB: OPS (slow) [stopped]

[ 63] SAPDB: OPS (omststknl.exe) [stopped]

[ 64] sapccmsr.00 [stopped]

[ 65] sapccmsr.02 [stopped]

[ 66] sapccmsr.10 [stopped]

[ 67] SAPOAE_02 [running]

[ 68] SAPODE_00 [running]

[ 69] SAPOPS_10 [running]

[ 70] SAPOPS_11 [running]

[ 71] SAPOsCol [running]

[ 72] SAPSMD_96 [running]

[ 73] SAPSMD_97 [running]

[ 74] SAPSMD_98 [running]

[ 75] Smart Card [stopped]

[ 76] Task Scheduler [running]

[ 77] Secondary Logon [running]

[ 78] System Event Notification [running]

[ 79] Windows Firewall/Internet Connection Sha [stopped]

[ 80] Shell Hardware Detection [running]

[ 81] Print Spooler [running]

[ 82] Windows Image Acquisition (WIA) [stopped]

[ 83] Microsoft Software Shadow Copy Provider [stopped]

[ 84] Performance Logs and Alerts [stopped]

[ 85] Telephony [stopped]

[ 86] Terminal Services [running]

[ 87] Themes [stopped]

[ 88] Telnet [stopped]

[ 89] Distributed Link Tracking Server [stopped]

[ 90] Distributed Link Tracking Client [running]

[ 91] Terminal Services Session Directory [stopped]

[ 92] Windows User Mode Driver Framework [stopped]

[ 93] Uninterruptible Power Supply [stopped]

[ 94] Virtual Disk Service [stopped]

[ 95] VMware Tools Service [running]

[ 96] VMware Upgrade Helper [running]

[ 97] VMware Snapshot Provider [stopped]

[ 98] VMware Physical Disk Helper Service [running]

[ 99] Volume Shadow Copy [stopped]

[100] Windows Time [running]

[101] WebClient [stopped]

[102] WinHTTP Web Proxy Auto-Discovery Service [stopped]

[103] Windows Management Instrumentation [running]

[104] Portable Media Serial Number Service [stopped]

[105] Windows Management Instrumentation Drive [stopped]

[106] WMI Performance Adapter [stopped]

[107] Automatic Updates [running]

[108] Wireless Configuration [running]

[109] Network Provisioning Service [stopped]

[110] XServer [running]

regards

Michael

[Former Member]

Franz

Yes it is an Dialog instance only on Win 2003 x64 (for Adobe ADS) and connects (well up until now) to the Iseries database host.

I put the new kernel 258 on the OS400 side and it is good, the central instance (APAP+JAVA stack) runs as before.

I copied the old exe directory back on the Windows side and tried starting again in the MMC but exactly the same error again- this is with older kernel level on the Windows exe directory.

regards,

Michael

[franz_hiltscher]

Could you post dev_wp log please.

Maybe a communication problem with the message server.

Kind Regards

Franz

[franz_hiltscher]

obsolete

Edited by: Franz Hiltscher on Jun 17, 2010 4:46 PM

[Former Member]

Hi Franz

Thanks.

dev_disp dev_rd and dev_w<x> WP trace files are all last dated 16/6/10 when the instance was stopped before the kernel upgrades.

In all the attempts to startup since, these files have not changed inthe work directory.

The files that have new entries are -

stderr1 - shm errors

sapstartsrv.log

sapstart.log

sapcpe.log (no errors)

regards

Michael

e.g sapstart.log

SAP-R/3-Startup Program

Starting at 2010/06/18 0:18:17

Startup Profile: "
OLTOISSDA\sapmnt\OAE\SYS\profile\START_D02_OLTOVMDQ"

Starting Programs

(4588) Execute:
OLTOISSDA\sapmnt\OAE\SYS\exe\uc\NTAMD64\sapcpe.EXE pf=
OLTOISSDA\sapmnt\OAE\SYS\profile\OAE_D02_OLTOVMDQ

(1996) CreateProcess: D:\usr\sap\OAE\D02\exe\disp+work.EXE pf=
OLTOISSDA\sapmnt\OAE\SYS\profile\OAE_D02_OLTOVMDQ

(4056) CreateProcess: D:\usr\sap\OAE\D02\exe\igswd.EXE -mode=profile pf=
OLTOISSDA\sapmnt\OAE\SYS\profile\OAE_D02_OLTOVMDQ

sapstartsrv.log

-

---

trc file: "sapstartsrv.log", trc level: 0, release: "700"

-

---

pid 4876

Fri Jun 18 00:16:56 2010

SAP HA Trace: Build in SAP Microsoft Cluster library '700, patch 198, changelist 1047390' initialized

Initializing SAPControl Webservice

SapSSLInit failed => https support disabled

Starting WebService Named Pipe thread

Starting WebService thread

Webservice named pipe thread started, listening on port
.\pipe\sapcontrol_02

Webservice thread started, listening on port 50213

OLTOVMDQ\oaeadm is starting SAP System at 2010/06/18 0:18:17

stderr1

Fri Jun 18 00:18:36 2010

• ERROR => [CreateOsShm] CreateFileMapping(37,65 KB) failed with Err=5

ERROR_ACCESS_DENIED: Access is denied. [shmnt.c 2174]

• ERROR => ShmCreate: Create (37,67072,1) failed [shmnt.c 506]

[franz_hiltscher]

Hi,

please check the Windows Eventlog.

Is there a entry similar to: "Unable to process specified Profile: pf=<path_to_startprofile>,

ErrorText: Access is denied. (ErrorNo: 5)"

Regards

Franz

[Former Member]

Hi Franz

- Win 2003 Event log

Application events:

18/6/10 10:53PM

Source: Application error

Category (100)

Type: Error

Faulting application dispwork.EXE, version 7000.258.17.48835, faulting module dispwork.EXE, version 7000.258.17.48835, fault address 0x000000000008210e.

18/6/10 10:52:49PM

Source SAPOAE_02

Category None

Type:Error

User: N/A

Computer OLTOVMDQ

[CreateOsShm] CreateFileMapping(37,65 KB) failed with Err=5 ERROR_ACCESS_DENIED: Access is denied.

18/6/10 10:52:04PM

Source SAPOAE_02

Category None

Type: Error

SAP Service SAPOAE_02 successfully started.

Entry for MS Visual C++ update with vcredist_x64.exe

Source MsiInstaller

User OLTOVMDQ\oaeadm

Computer OLTOVMDQ

Product: Microsoft Visual C++ 2005 Redistributable (x64) -- Installation completed successfully.

-

---

I also tried as you suggested earlier to go back to the older kernel (patch level 197) on the Windows 2003 application server, when I did this and started the instance,it stopped in the same place with the same errors as before.

regards

Michael

[franz_hiltscher]

Has the sapservice user sufficient rights?

Note 82751 - Problems with SAP Services & SAP Service Manager

Note 142100 - Windows: Problems with new SAP service as of Rel. 4.5B

I'am not sure but it could be a possible solution to recreate the sap windows services.

Kind Regards

Franz

[Former Member]

It was a problem with the permissions on the exe directory. The groups

SAP_LocalAdmin and SAP_<SID>_LocalAdmin were not there in the Security settings for the directory.

So problem solved by redoing the sapcar from the sar files into a new directory under usr\sap\<SID>\D<nn> path.

Then I could start the instance successfully via the MMC.

Thanks for all your replies, I certainly have learnt a few things from this.

regards

Michael

[Former Member]

Do you have the chance to completly shutdown the instance as well as all processes and perform a cleanipc that removes all shared memory segments of the instance?

Afterwards try to restart the instance and see if it starts normally as expected.

[Former Member]

Thanks Sven,

I will try the reboot again - I know with the Windows operating system this normally does wonders... I tried once already.

regarding the CLEANIPC - does this exist for Windows operating system in the SAP kernel?

I would love to be able to run a CLEANIPC 02 remove command like in Unix or OS/400.

regards,

Michael