Modification check in File Adapter

[former_member254369]

Hi,

We use the Msecs to wait before Modification Check to ensure that our files are complete before PI picks them up to process them.

The files are created by a SAP standard Program, that opens the file on the AL11 Server, writes to it and then completes. The processing can take up to 15 mins and we create up to about 20 files.

The modification check is then set to be 15 mins to ensure the file is completely written. However in PI this modiciation is then set to all the files. For example if I have 3 files to be picked up, PI waits 15 mins , processes first file...waits 15 mins...processes 2nd file and then waits 15 mins again and processes the last file.

Is there any way to get this to work so If it sees 3 files, it waits 15 mins and then does all 3 ??

Or how else can PI tell if it is picking up a file off the ECC server that ist is complete ?

Another option is to start renaming the files in a batch job that checks if they are complete but we would rather not do that.

Thanks

Brian

[former_member190293]

Hi Brian!

Let me ask first: why did you set checking interval for 15 mins?

I would set that interval, for example, to 300 msecs. If the file size is changed after given delay, PI skips that file till next polling attempt. And if other files exist which have already been written - PI will take it after 300 msec delay.

Regards, Evgeniy.

[former_member254369]

Hi Evgeniy,

We found this did not work correctly when using it with the File Adapter and files being written in SAP...PI did not see the file size change so would still pick up the file as it was being written...so the modification is used to ensure it is finished.

The Modifiction check works fine and correctly with some of the FTP adapters we use

[former_member190293]

Hi Brian!

Don't you use FCC in your file adapter?

Regards, Evgeniy.

[manoj_khavatkopp]

Adding to Eve's reply :

You say :

The Modifiction check works fine and correctly with some of the FTP adapters we use

This is sometimes dependent on FTP vendors as well not all FTP servers support to check modification.

Br,

Manoj

[former_member254369]

@Evgeniy We dont need Content conversion...We are simply picking up a file and passing it thru with no changes within PI. That all works fine but ths issue is that the SAP prpogram creating the file, opens the file, then writes to it...If PI polls and the file is there the modification check does not work and it picks it up straight awa

@Manoj Yes we have Modification check working on other FTPs.The issue here is using the File Adapter and picking up from an ECC system

[former_member190293]

Hi Brian!

Is there any chance to use signal file instead?

Regards, Evgeniy.

[TomXing]

Hi Brian,

1. You shouldn't set the interval to 15 minutes, unless the file writing is exactly like
Creating the file -> absolutely idle for 15 minutes -> write everything into the file.

2. Files are currently processed one by one, not in parallel.
You can create multiple channels if you need them to be.

Best regards,
Tom

[Harish]

Hi Brian,

The file modification check is to use in the millisecond and the second change in the file. and ideally, it should be less than the polling interval.

For your requirement best way is SAP write the file in some other extension (e.g. .tmp) and as the last step of job/process change the extension to the one required for the file. This will remove the requirement of the high value of modification check.

regards,

Harish

[PRAGSMATIC]

I know... this is kind of a misleading feature... but it is the way it is currently.

[xinjiang_li]

Hi Brian,

You could consider adjusting the poll interval parameter or by setting availability time planning for the channel to meet your demand.