Skip to Content
0
Former Member
Aug 11, 2016 at 09:11 PM

loading 2lis history(Full) data is super slow

54 Views

Hi folks,

We are in a trouble of loading the history data of 2LIS* from ERP to SQL data mart. In order to not disturb the Delta load, I imported the data source as Query mode and used it as the source in a regular data flow. Totally, for billing data, we have around 170 M records as the history data. We tried to fill in the setup table as 1M, the performance is so bad. Reduce to ten thousands, it's oaky. But it's not realistic that loading such a small dataset each time. Does anyone have good idea on the full load of 2Lis data or what we could do to improve this? (For general performance optimization for BODS jobs, we have already tried. I would like to know if there is any specific strategy to handle the 2LIS full load)

Thanks for any help!