Skip to Content
0
Aug 12, 2023 at 11:05 AM

How to using Pagination in dataloading with HANA SDA (dpserver) via OData from MSSQL

76 Views Last edit Aug 14, 2023 at 06:44 AM 5 rev

Hello,

within HANA (dpserver) we are loading Data from MSSQL via OData.
Connection is setup with SDA, no separate DP-Agent is installed (SDI).

But when loading data from MSSQL tables which has more then 150.000 datasets, (limit for one OData-page) and we get following error-message, (because we dont know how to use pagination)

Could not execute 'select * from "/BIC/*****"' in 2.938 seconds.<br>SAP DBTech JDBC: [403]: internal error: Remote execution error connection to ****:443 <br>returned status 500 message: {"type":"urn:cluu:500","title":"Internal Server Error","status":500,"detail":<br>"The query result count is too large. The query is canceled.",

We tried to research, how to use this OData-pagination-feature within HANA-SDA but could not find any possibility.
help.sap.com/hana gives no hint to use it within SDA, (maybe only within XSA, but we dont have this active for now.)
https://help.sap.com/docs/SAP_HANA_PLATFORM?locale=en-US&q=Pagination

Somebody can help us, how we can load full data with just one DTP finally?

Additional Information:
- MSSQL is setup as SourceSystem
- its tables are setup as DataSource and finally are loaded via DTPs.
For now we have to add every week a new DTP in processchain, which is loading the next 150.000 datasets, but this is for shure not a solution. But we cannot find a way to use this OData pagination-feature.


HANA can do it at all?

Greetings and great thanks
Tobias