Entire data of the file not passing PI

[former_member188885]

Hi All,

I have a File to Proxy scenario. When the file is posted continously in the ftp, and if the volume of the file is huge, PI is not processing all teh records in teh file.

A File was posted in the ftp. The first time it showed that 19958KB of data had passed. meaning only half of the records from the file was processed.When the same file was processed after sometme 525210KB of data was processed, meaning the entire file was processed.

Could you explain the reason for thia and how to rectify this problem?

[Shabarish_Nair · Accepted solution]

this could be because of partial read.

Use a higher polling interval and also utilize the option

Advanced Mode

To specify additional parameters in the adapter configuration, set the Advanced Modeindicator.

u25CF      Msecs to Wait Before Modification Check

Enter the number of milliseconds that the adapter must wait before it checks whether the files have been changed.

[naveen_chichili]

HI Lavanya,

As Shabarish said increasing a polling intraval may solve this issue.

Regards,

Naveen

[Former Member]

Hi,

PI is having a problem of processing HUGE amount of data, we can successfully process the huge file in chunks based on the recordset.

Set the Parameter, for eg. Recordset Per Message = 100 (means 1 thread/message in MONI will contain 100 records)

If your file contains 1000 Records info, it will get divided into 10 messages.

[Former Member]

Hi,

PI is having a problem of processing HUGE amount of data, we can successfully process the huge file in chunks based on the recordset.

Set the Parameter Recordset Per Message = 100 (means 1 thread/message in MONI will contain 100 records)

If your file contains 1000 Records info, it will get divided into 10 messages.