How can I get the HANA Cloud Relational Data Lake storage size programatically?

[former_member722246]

I need the information about HANA Cloud Relational Data Lake storage size that can be accessed programatically (I can see this info in HANA Cockpit, the size is 1TB). I was able to find this information for HANA Cloud Database (select round(max(total_size)/1024/1024/1024) from SYS.m_disks) but I can't find such option for connected data lake. From what I see it's quite complicated to operate on this data lake (CALL SYSRDL#CG.REMOTE_EXECUTE) but I also played with it and was not able to find solution to my problem. How can I programatically access this info?

[markmumy]

HI Magdalena,

In the current implementation this is very difficult due to the security restrictions put in place and the use case that the data lake operates under.

At the end of Q1 (see http://roadmaps.sap.com for details and exact timelines/committments), we plan on releasing a new version of the data lake that allows you to directly connect to it via a SQL endpoint so that you no longer would have to use REMOTE_EXECUTE, if you so choose. Also, this release is going through a security overhaul so that things that are quite easy to do with the data lake on premise (SAP IQ). For instance, normally, we would use the procedure sp_iqdbspace to get high level size information. This is not available today, but should be exposed in the future.

Mark

[markmumy]

Hi Magdalena,

I have also put together a blog on how to capture the object sizes via SQL (programmatically).

https://blogs.sap.com/2021/01/13/hana-data-lake-size-and-row-monitoring

This walks you through being able to capture the table sizes in the current data lake version as well as the code to work in the next generation that will have a direct SQL Endpoint.

There is also a blog from October that covers how to just capture the table sizes.

https://blogs.sap.com/2020/10/26/how-much-storage-am-i-using-in-the-sap-hana-cloud-data-lake/

Mark

[former_member722246]

Thank you, Mark.

But this returns the usage info for given table. What I need is the storage value allocated for HANA Data Lake as a whole.

Isn't there any way (query or endpoint) where I can access it? I see that the cockpit is using /getHANACloudServiceInstanceParameters endpoint?

[markmumy]

I completely understand. With the current data lake, the procedures and tables that show the current size and consumption are not exposed. These will be exposed with the next release at the end of Q1 (March) 2021.