Skip to Content
-1

What are the limitations of Hana Smart Data Integration /EIM

Hi Experts,

We have on Premise Hana 1(SPS12) multinode landscape in scale out configuration with different firewall zones.We are evaluating the SAP HANA EIM(Smart data Integtration and Smart Data Quality) as a DP/ETL tool. In this regard I have the following questions:

1) Is there any limit on the data transfer using SDI for a single replication/pull request.For example maximum number of rows/columns that can be transferred from any Source to HANA?Is there a limitation on data size(in MB/GB)?

2)Is there a limitation on number of parallel replications/batch jobs/pull or push requests in context of DP Agent or DP Server?

3)I have read it in the installation guide that DP Server and DP Agent do not support load balancing in scale out scenarios.Can there be a workaround for this?If not, what can be an ideal setup to handle high loads(lets say a total 5 billion entries in a day from 1000 executions) ?

4)Can oData adapter installed and configured on a DP Agent instead of DP Server?

5)Where can I find the information like advantage/disadvantage of various SAP provided adapters to make an informed choice?

Hi Werner Daehn :

I have learnt a lot about SDI from your blogs, can you please guide me to find answers to above questions.

Thank you so much in advance.

Regards

Manas

Add a comment
10|10000 characters needed characters exceeded

Related questions

1 Answer

  • Posted on Oct 01, 2018 at 02:46 PM
    1. No data size limit, per se, but HANA must have sufficient free memory to handle the incoming data. One possible exception is due to an Oracle performance limitation, we depend on Oracle log miner which cannot process more than about 1TB/day.
    2. Again, no hard limitation assuming the systems are sized appropriately ('appropriate' varies depending on data volume and parallelization).
    3. Based on the documentation I'm reading, DPAgent and DPServer don't support load-balancing, but failover is supported for real-time requests. I would say that 5bn records through the course of a day is not exceptionally high, assuming the loads are partitioned or spread across multiple agents there should be no issue with that volume.
    4. OData Adapter is only deployed on DPServer.
    5. Pages 18-20 of the PAM quick guide show capabilities of each SDI adapter, including real-time support, source/target support etc.

    Hope I have answered your questions adequately.

    Jeff K

    Add a comment
    10|10000 characters needed characters exceeded

    • Jens Schwendemann

      Oh, that's an easy one: SAP has clear guidelines when to use what product. Unfortunately these vary depending on whom you talk to.

      • If you ask the EIM team, SAP Data Intelligence can do everything.
      • If you ask the Cloud team, CPI can do everything.
      • If you ask the S/4Hana team, oData based integration can do everything.

      That is at least what I have seen at my customers.

      The official answer from Christian Klein is this: https://www.sap.com/documents/2020/02/520ea921-847d-0010-87a3-c30de2ffd8ff.html

      As you asked for ETL tools, Data Services is still the best tool in the entire market, in my personal opinion. "Best" in terms of productivity and TCO. For realtime SAP Data Integration I promote a solution using Apache Kafka.

      But as we are getting into a political mine field here, feel free to contact me by email.

      There is an entire series on SAP Data Integration products published, maybe that is of value? e.g. this one as starting point.

Before answering

You should only submit an answer when you are proposing a solution to the poster's problem. If you want the poster to clarify the question or provide more information, please leave a comment instead, requesting additional details. When answering, please include specifics, such as step-by-step instructions, context for the solution, and links to useful resources. Also, please make sure that you answer complies with our Rules of Engagement.
You must be Logged in to submit an answer.

Up to 10 attachments (including images) can be used with a maximum of 1.0 MB each and 10.5 MB total.