Skip to Content

How to upload Excel data to Application Enablement

Hello

For now we have a customer POC for PdMS CE. And customer has provided large volume of assets historical data in Excel format.

So I'm wondering how can we upload the Excel sensor data into AE so that PdMS CE can leverage these data for machine learning.

Thanks a lot!

Add a comment
10|10000 characters needed characters exceeded

Related questions

1 Answer

  • Posted on Sep 24, 2018 at 09:00 AM

    Hi, there is no bulk upload api that I'm aware of. Best option is to slice the data by thing id/property set and then use the default ingestion api (bypassing iot service and kafka): https://help.sap.com/viewer/350cb3262cb8496b9f5e9e8b039b52db/latest/en-US/a71c33f350d543429420611b37d74422.html . With this api you can ingest multiple years worth of data for one thing and one property set with one call.

    For the tooling you can either make Excel learn how to call our web apis (including the trick to get an oauth token) or you could write a node application, that takes the excel file as input with some degree of error handling.

    One more thing to consider if you make bulk write or read request is that there is a default timeout in cloud foundry for calls and if you call takes more then 2 minutes to process it will be canceled. So make sure your chunks are small enough, to not run into this problem.

    If you ingest different measurements for one property set and thing id for the same timestamp the last entry wins - this way you will not get duplicates if you by chance ingest the same data again. But you also need to be aware of the fact, that any duplicates or triples, that other tools might be able to handle, might get lost.

    Please be aware, that if you ingest data older then the default retention period via this api or if you ingest data that is in the future beyond 3 months from now, then the data is not ingested. To be able to ingest older data you have to (at least temporarely) change the retention period to before your first ingestion timestamp (current maximum is 5 years).

    Regards, Marcus

    Add a comment
    10|10000 characters needed characters exceeded

Before answering

You should only submit an answer when you are proposing a solution to the poster's problem. If you want the poster to clarify the question or provide more information, please leave a comment instead, requesting additional details. When answering, please include specifics, such as step-by-step instructions, context for the solution, and links to useful resources. Also, please make sure that you answer complies with our Rules of Engagement.
You must be Logged in to submit an answer.

Up to 10 attachments (including images) can be used with a maximum of 1.0 MB each and 10.5 MB total.