Skip to Content
avatar image
Former Member

Modification check in File Adapter

Hi,

We use the Msecs to wait before Modification Check to ensure that our files are complete before PI picks them up to process them.

The files are created by a SAP standard Program, that opens the file on the AL11 Server, writes to it and then completes. The processing can take up to 15 mins and we create up to about 20 files.

The modification check is then set to be 15 mins to ensure the file is completely written. However in PI this modiciation is then set to all the files. For example if I have 3 files to be picked up, PI waits 15 mins , processes first file...waits 15 mins...processes 2nd file and then waits 15 mins again and processes the last file.

Is there any way to get this to work so If it sees 3 files, it waits 15 mins and then does all 3 ??

Or how else can PI tell if it is picking up a file off the ECC server that ist is complete ?

Another option is to start renaming the files in a batch job that checks if they are complete but we would rather not do that.

Thanks

Brian

Add comment
10|10000 characters needed characters exceeded

  • Get RSS Feed

5 Answers

  • Nov 16, 2017 at 10:49 AM

    Hi Brian!

    Let me ask first: why did you set checking interval for 15 mins?

    I would set that interval, for example, to 300 msecs. If the file size is changed after given delay, PI skips that file till next polling attempt. And if other files exist which have already been written - PI will take it after 300 msec delay.

    Regards, Evgeniy.

    Add comment
    10|10000 characters needed characters exceeded

  • avatar image
    Former Member
    Nov 17, 2017 at 08:40 PM

    Hi Brian,

    You could consider adjusting the poll interval parameter or by setting availability time planning for the channel to meet your demand.

    Add comment
    10|10000 characters needed characters exceeded

  • Jun 29 at 06:57 AM

    Hi Brian,

    The file modification check is to use in the millisecond and the second change in the file. and ideally, it should be less than the polling interval.

    For your requirement best way is SAP write the file in some other extension (e.g. .tmp) and as the last step of job/process change the extension to the one required for the file. This will remove the requirement of the high value of modification check.

    regards,

    Harish

    Add comment
    10|10000 characters needed characters exceeded

  • Jun 29 at 07:06 AM

    Hi Brian,

    1. You shouldn't set the interval to 15 minutes, unless the file writing is exactly like
    Creating the file -> absolutely idle for 15 minutes -> write everything into the file.

    2. Files are currently processed one by one, not in parallel.
    You can create multiple channels if you need them to be.

    Best regards,
    Tom

    Add comment
    10|10000 characters needed characters exceeded

  • Jun 28 at 04:11 PM

    I know... this is kind of a misleading feature... but it is the way it is currently.

    Add comment
    10|10000 characters needed characters exceeded