Hello,
I am facing the following challenge in one of my current development. I know it is an age old issue but Would greatly appreciate
some new inputs/views into this.
The following is the scenario.
1. PI 7.3 Sender File adapter (FTP) reads the file from the mainframe (MVS)
2. The MVS dataset is like
TEST.MVS.DATA.C001D00
TEST.MVS.DATA.C002D00
TEST.MVS.DATA.C003D00 ....
3. For a specific reason the MVS file is not allowed to be deleted/archived, were as the new file will be keep on adding (004, 005, 006 ....)
3.1 Handled this using "ftp. ignoreSourceFileDeletion " -- true
4. Now the challenge in SAP PI is "how to READ the NEW files ONLY, ignoring/skipping the old files"
4.1 The file size is big enough to avoid reading all files and filter/delete using Mapping/Script
5. I have used the default "Duplicate Handling" option available in the File Sender adapter, but
5.1 the problem is, the channel throws the duplicate error after processing the first file (DATA.C001D00)
but dose not move on to process the next file (since the first file is still available on the FTP, as mentioned in step 3).
5.2 For every poll interval it throws the duplicate error/message (in CC monitor) for the first file again n again.
5.3 Duplicate handling config :- Duplicate Message Alert Threshold = 0
Pls let me know if you have had a similar scenario and how to handle it.
Adapter module would be a last resort :-)
Thanks in advance
Prasanna