Skip to Content

How to split a huge file into small chunks?

Nov 06, 2017 at 10:57 AM


avatar image
Former Member

The requirement here is to read a .csv file with around 100 to 200MB file size having around 50k to 100k records. As this is too huge for processing, the file must be split into chunks of 10,000 or 5000. File structure is given below. Please let me know how to configure recordsets per message option in FCC to achieve this. I already tried, but it failed.

Also, the chunks must be processed in sequence. If the sequence is missed, it will cause difficulties in further processing of data in target system.

File Structure :


Country 1

Country 2

10 |10000 characters needed characters left characters exceeded
* Please Login or Register to Answer, Follow or Comment.

1 Answer

Harish Mistri Nov 07, 2017 at 12:33 AM

Hi Poornima,

Please refer the below blog



Show 1 Share
10 |10000 characters needed characters left characters exceeded
Former Member

Hi Harish,

Thank you very much for sharing this information. Will refer to it when changing configuration in file channel.


Poornima S