Hi All,
Requirement: We need to send the 5 lakh product data from SAP Commerce cloud to SAP Emarsys via CPI.
CPI need to pick the 20 different CSV files (each file contains Approx 25,000 products data) from the sftp server and merge them into one file and perform data transformation in CPI and push the file into target sftp server (target system will pick CSV file).
Solution Implemented: In CPI, I am using poll enrich to pick the each and every CSV file and enriching all files into one file and converting file from CSV to XML and splitting (general splitter) data into single record and performing the data transformation in message mapping and gathering into one file and converting this XML to CSV and placing that file into target sftp server.
Question: Can CPI handle the this much of load to process? If not what's the maximum limit in CPI. Is there any alternative way to achive this.
Regards,
JK.