SAPSYS user slowing down SAP System

[former_member217353]

Dear Experts,

Our SAP DEV System is very slow after a RESTART, user SAPSYS running SAPMSSY2 program in client 000 consuming all the BTC processes and few DIA as well.

I tried following things to resolve :

1. As recommended by note 183648 - SAPMSSY2: long runtime in background process   DERANGEMENTED DISK to just 2% fragmentation now

2."Consistency check DB Tables" terminated with RUNTIME ERROR TIME_OUT.

3. No ARFC jobs are active in sm59

Please suggest to resolve this issue.

Kind Regards,

Domnic.

[feng_shi]

Hi,

the SAPMSSY2 program is the batch scheduler program,it will be executed every rdisp/btctime by sap system user SAPSYS and also be executed when a job finished.

when execute SAPMSSY2 program, it will check batch job tables TBTCO and TBTCS ...

Also, when do sm65 inconsistency check, it will also check batch job tables TBTCO and TBTCS...

For batch job tables, please refer to following wiki:

http://wiki.scn.sap.com/wiki/display/TechTSG/Database+Tables+for+Background+Processing+system

For SM65, please refer to :

http://wiki.scn.sap.com/wiki/display/TechTSG/FAQ+-+SM65

Regarding of this issue:

SAPSYS user is using Program SAPMSSY2 and consuming resources and transaction sm65 ending with runtime error : TIME_OUT

Probably because that there are some invalid date entries in the TBTCO and TBTCS table(e.g. SDLSTRTDT colume),and because of this, there are a lot of TIME_OUT dumps which relate to program "SAPMSSY2", and the TIME_OUT dumps incidents that SAPMSSY2 program entry in a endless looping and finally time out due to rdisp/max_wprun_time parameter restriction.

For such situation, I've also summarized into following BTC wiki page:

http://wiki.scn.sap.com/wiki/pages/viewpage.action?pageId=405178099

At last, there is a BTC wiki page which included almost all the known issues,

I believe you will get benefit when you have issue about BTC.

http://wiki.scn.sap.com/wiki/display/TechTSG/SAP+Background+Processing

Thanks and best regards,

Shi Feng

[Former Member]

Is the JBLOG file very big? Are you running the cleanup process for joblogs (RSBTCDEL2)? You might try running this as DDIC in client 000.

Does it take long for SAPSYS to use up all the background processes?

Thanks!

Joe

[former_member217353]

Dear Haynes,

Appreciate your reply JOBLOGs are of size 688-660 bytes or less mostly, but DEV_W15.DEV_W16...W19 are very huge almost 14mb in size. and dev_w16.old is 38 mb

I ran RSBTCDEL2  in GUI shows its running but when i checked DEV-W15 log it says disconnected from database, kindly check the attached last 1024k bytes  Dev-W15 log.

Yes SAPSYS keeping all background jobs busy.

Kind Regards,

Domnic

Dev_W15.txt.zip

[Former Member]

Hi,

Could please also share the DB alert log file and latest wp log file.

br,

Koushal Solanki

[former_member217353]

Dear Solanki,

Appreciate your reply please find the links for   full Dev_W19 log and AlertLog as they are not attachable with SCN message because of their  size.

Dev_W19 file :

dev_W19.txt - Google Drive

Alert log file :

alert_dev.log - Google Drive

Kind Regards,

Domnic

[Former Member]

You might want to try and run BTCTRNS1 and unschedule all the background jobs. That would give you the chance to review the system and without having to fight all those background tasks.

Your system may be trying to play catch up with jobs that are being released but never completely finishing.

I looked at your logs but did not see anything specific that is causing the issue.

Do you have external connections to the DB that might be using up the sessions? How many wp's do you have?

Thanks!

Joe

[former_member217353]

Dear Experts,

I still have SAPSYS users using all the BACKGROUND jobs here are  the ERRORS

1.Developer_Trace :

Dev_W15 :

xhead.c   14350]

M  *** ERROR => ThCallHooks: event handler rstshpc_hook_prepare_for_commit for event BEFORE_COMMIT failed [thxxtool3.c  303]

M  {root-id=005056A57CA41ED58C8339A530E7F706}_{conn-id=00000000000000000000000000000000}_0

B  ComRolHook(BEFORE_COMMIT, free_all) failed

B  db_con_commit received error -1 in before-commit action, returning 8

M  ***LOG R38=> ThICommit3, db_commit98 ( 001024) [thxxhead.c   14350]

M  *** ERROR => ThCallHooks: event handler rstshpc_hook_prepare_for_commit for event BEFORE_COMMIT failed [thxxtool3.c  303]

M  {root-id=005056A57CA41ED58C8339A530E7F706}_{conn-id=00000000000000000000000000000000}_0

B  ComRolHook(BEFORE_COMMIT, free_all) failed

B  db_con_commit received error -1 in before-commit action, returning 8

M  ***LOG R38=> ThICommit3, db_commit98 ( 001024) [thxxhead.c   14350]

M  *** ERROR => ThCallHooks: event handler rstshpc_hook_prepare_for_commit for event BEFORE_COMMIT failed [thxxtool3.c  303]

M  {root-id=005056A57CA41ED58C8339A530E7F706}_{conn-id=00000000000000000000000000000000}_0

B  ComRolHook(BEFORE_COMMIT, free_all) failed

B  db_con_commit received error -1 in before-commit action, returning 8

M  ***LOG R38=> ThICommit3, db_commit98 ( 001024) [thxxhead.c   14350]

M  *** ERROR => ThCallHooks: event handler rstshpc_hook_prepare_for_commit for event BEFORE_COMMIT failed [thxxtool3.c  303]

M  {root-id=005056A57CA41ED58C8339A530E7F706}_{conn-id=00000000000000000000000000000000}_0

B  ComRolHook(BEFORE_COMMIT, free_all) failed

B  db_con_commit received error -1 in before-commit action, returning 8

M  ***LOG R38=> ThICommit3, db_commit98 ( 001024) [thxxhead.c   14350]

M  *** ERROR => ThCallHooks: event handler rstshpc_hook_prepare_for_commit for event BEFORE_COMMIT failed [thxxtool3.c  303]

M  {root-id=005056A57CA41ED58C8339A530E7F706}_{conn-id=00000000000000000000000000000000}_0

B  ComRolHook(BEFORE_COMMIT, free_all) failed

B  db_con_commit received error -1 in before-commit action, returning 8

M  ***LOG R38=> ThICommit3, db_commit98 ( 001024) [thxxhead.c   14350]

M

M Wed Jul 22 04:32:47 2015

M  *** ERROR => ThCallHooks: event handler rstshpc_hook_prepare_for_commit for event BEFORE_COMMIT failed [thxxtool3.c  303]

M  {root-id=005056A57CA41ED58C833C36062DB706}_{conn-id=00000000000000000000000000000000}_0

2.SM21 :

TemSe input/output to unopened fiTemSe input/output to unopened file.

All the users have read/write permissions to the directory \\hostname\sapmnt\sap\sid\sys\global

Experts Kindly guide me to solve this.

Kind Regards,

Domnic.

[Sriram2009]

Hi Domnic

1. On your Windows OS page file location on local or SAN disk?

2. What is the parameter value "rdisp/PG_MAXFS" ? if it is low try to increase the value and then check ..

Regards

SS

[former_member217353]

Dear SS,

Appreciate your reply Page file is set on Local Server you can check  the screen.

the parameter rdisp//PG_MAXFS is already on 32gb which i think is fair enough.

Kind Regards,

Domnic.

[divyanshu_srivastava3]

Check for issues in the database.

For eg. a database dead lock.

Also, share the DB logs once.

Can you see share the screenshot of dpmon ?

Regards,

[former_member217353]

Dear Srivastava,

Appreciate your reply, Kindly check the attached Oracle Logs and DPMON details from CMD.

Kind Regards,

Domnic.

DPMON.txt.zip

ceqyjrsn-SAPCHECk.txt.zip

dev_ora_6568.txt.zip

[Sriram2009]

Hi Domnic

1.  Check this SAP Notes for "ORA-00020: maximum number of processes 80 exceeded"

34432 ORA-00020: maximum number of processes exceeded

539755 - ORACLE ERROR : Maximum Number of Processes(80) Exceeded

2. You may require to upgrade the Kernel & DBSL patch from current release to either 7.21 or 7.22.

Regards

SS

[divyanshu_srivastava3]

Thank you Domnic for providing me the log files.

As you can see, in the database logs - once issue is reported.

ORA-00020: maximum number of processes 80 exceeded

To fix this.

1.st Try to restart you database and clean the shared memory.

If above is not working, then goto 2nd point.

2nd. Increase the parameters 'processes' and 'sessions' by 40%-50% in the profile initDEV.ora.

Now restart the database.

Regards,

[former_member217353]

Dear Experts,

I have

1.Restarted the whole system from OS level

2. Increased Processes and Sessions

    a. old value processes =80

        new value = 115

    b. old value =160

        new value = 220

Still Iam seeing same user SAPSYS using Program SAPMSSY2 and consuming resources and transaction sm65 ending with runtime error : TIME_OUT.

Regards,

Domnic.

[Sriram2009]

Hi

Could you share your SAP kernel release, level & OS / DB?

BR

SS

[former_member217353]

Hi SS,

SAP Kernel Information                                                                

|SAP Kernel :  720_REL                                                                 

|Database Client Library : OCI_10201_SHARE, 10.2.0.4.0                                 

|created in  :  NT 5.2 3790 S x86 MS VC++ 14.00                                        

|created on  :  Jul  8 2012 23:15:28                                            

|Support Level  :  0                                                                   

|Kernel Patch number : 300                                                       

|Source ID  :  0.300                                                                  

|DBSL Patch No. : 215                                                                 

|ICU Version : 3.4 Unicode Version 4.1                                                 

|libsapu16 Version : 2.0025  Jul  8 2012 19:57:48  

OS: WINDOWS SERVER 2008 R2

Database : Oracle 10g : 10.2.0.5.0

Kind Regards,

Domnic