Extreme high cpu load on hbdindexserver

[prudhvi_ravipati]

Hello All,

One of our servers running HANA has an extreme high cpuload on hdbindexserver. Due to this HANA and SAP hangs while doing business.

when I run the top command I get the following result:

Once we restarted the linux server everything going to be normal. we are using SUSE 12 SP3 with Hana Version 122.21.

How can we prevent this type of issues from hanging our server. Thanks for advising,

Best Regards,
Prudhvi.

[dvankempen]

You asked a question. Don't forget to mark the answer that helped you most as correct. Thanks!

For the readers, before you leave, don't forget to up/down vote the answers. You can vote on the question too.

Thanks.

[sankar_27 · Accepted solution]

Hi Prudhvi,

please check KBA updates https://launchpad.support.sap.com/#/notes/2687490

collect sql and performance trace with statement type : DML, DDL, PROCEDURE, TRANSACTION , SESSION and SYSTEM.

A high CPU consumption could be caused by the reasons including but not limited to:

• Execution of certain transactions
• Data loading
• Hanging jobs
• Long-running SQL statements

They will generate a high calculation workload on CPU by either frequent access to the database or joining between huge tables.

• Bugs in HANA revisions
• XS jobs schedules etc.

Thanks , Sankar

[dvankempen]

Hi Prudhvi,

As you know, top is a UNIX/Linux command. Returns metrics. No context.

To investigate you would need to use tools like SAP HANA cockpit. Here are some starting points.

• 2100040 - FAQ: SAP HANA CPU
• SAP HANA Troubleshooting and Performance Analysis Guide

Should you need support specific to your environment, best to create a support ticket

• support.sap.com

[Private_Member_467521]

Hi prudhvi_ravipati,

First, try to isolate what is the thread that is harming your system.

You can view what threads are executed with the query:

select current_time, THREAD_ID,connection_id,PORT,HOST,SERVICE_NAME,THREAD_TYPE,THREAD_METHOD,substr(THREAD_DETAIL,1,40) threadDetail, thread_state ,application_user_name, caller,calling,DURATIONfrom m_service_threads where thread_state <>'Inactive'or thread_method like'Backup%'orderby service_name, connection_id

Then it is time to troubleshoot the indexserver_<host>.trc from /usr/sap/<SID>/HDB<SYSNUM>/host/trace

Consider reviewing THP related configuration. Check this great blog from Michael Healy for details - https://blogs.sap.com/2015/11/27/troubleshooting-sap-hana-high-cpu-utilisation/.

Deploy HANASitter, a monitoring script to automatically create dump files at certain scenarios for SAP HANA.

https://launchpad.support.sap.com/#/notes/2399979

Finaliy, look at the HANA CPU FAQ

https://launchpad.support.sap.com/#/notes/2399979

I am confident you will find the issue and fix it using these assets.

Cheers,

Luis

[murat_pusk]

Hi, Could you find any proper solution for this situation ?

[SriKrishna]

Hi,

identify the periods of high CPU using SQL HANA_Resources_CPUAndMemory_History_1.00.74+_ESS.txt found in note 1969700.

Please use SQL HANA_Threads_ThreadSamples_FilterAndAggregation_1.00.120+.txt ( check note for your hana version )found in note 1969700 and filter for running threads during the period of high CPU.

important fields in thread samples are THREAD_METHOD, THREAD_DETAIL,APP_USER etc. find relevant process in SAP application server using tools like sdfmon etc and then identify the CPU consuming process.