Skip to Content

Processing files in Sequence using FTP Adapter

Hi Experts,

I have searched several forums but i am not clear on how to process the files using FTP Adapter based on Timestamp.

To process the files in sequence i.e, FIFO using FTP Adapter

i have the files with file name customer and timestamp : customer<yyyyMMddHHmmss>

there are around 50 files in the FTP server llike this.

I need to process these files acording to the timestamp and place the files in same processing sequence in the receiver end using the file adapter.

If i specify the parametes in sender FTP Adapter as

Qos= EOIO

Queue name = ACCOUNT

Whether these parameters would do the processing in sequence according to the Timestamp?

Suppose if the queue ID for Inbound(SMQ2) is XBTI0_ACCOUNT then whether it will be the same for Outbound(SMQ1)?

Kindly suggest me how to process the files in sequence according to the Timestamp using FTP Adapter

Please reply..

Thanks

Sai

Add a comment
10|10000 characters needed characters exceeded

Assigned Tags

Related questions

3 Answers

  • Posted on Aug 23, 2011 at 08:38 AM

    first of all to process files in a sequence you have to use NFS protocol instead of File in the file adapter.

    The you have the ability to choose from the below;

    Processing Sequence (for transport protocol File System (NFS))

    If you used placeholders when specifying the file name, define the processing sequence of the files:

    ○ By Name: Files are processed alphabetically by file name.

    ○ By Date: Files are processed according to their time stamp in the file system, starting with the oldest file.

    Based on the above, all you need is to provide a queue name in the adapter and your requirement should be met.

    Add a comment
    10|10000 characters needed characters exceeded

    • Hi Shabarish,

      But this would require one more additional channel to process

      So i think it will take more time to process.

      Let me clarify my question once again.

      I need to Pick the files from FTP server based on their TimeStamp and in sequence.

      the file names are like this Customer<YYYYMMDDHHmmSS>.

      suppose i have 3 files as

      Customer20050413044534

      Customer20050414053430

      Customer20050315034533

      So i need to pick these files in this order and place the files in the same order to the receiver end(File Adapter)

      Customer20050315034533

      Customer20050413044534

      Customer20050414053430.

      As i am using FTP sender adapter i cannot use processing sequence "By Date".

      please suggest me on this.

      Thanks

      Sai.

  • author's profile photo Former Member
    Former Member
    Posted on Aug 23, 2011 at 08:42 AM

    Hi Sai,

    By making QoS to EOIO and mentioning the Queue name would not make sure that, FTP adapter would pick the files in the order.

    FTP adapter usuely polls the particular source directory in the FTP server and issues command LIST <filename_scheme>, in order to get the file information present in the sorce directory.

    If LIST FTP command provides the file names in whichever order (in order or out of order), FTP adapter would pick the files according to the LIST command has provided. Once the file is picked by FTP adapter then it will make sure that this file is proccessed in the EOIO manner inside the PI.

    So, To corss check that you can ask your FTP server team to provide FTP server traces and check what is the response to LIST command. Usually it would be ordered one only but you can check with them.

    Thanks,

    RK

    Add a comment
    10|10000 characters needed characters exceeded

  • Posted on Aug 23, 2011 at 10:52 PM

    Hi Sai,

    I understand the scenario as (Source folder) FTP -> XI -> NFS (Target folder).

    Let say everyday 10:00 AM, 50 files are placed in Source folder. These 50 files have timestamp in file name Customer<YYYYMMDDHHmmSS>. Let say, it takes 1 hour to process all these file and place them in Target folder (randomly processed). Files in target folder will have same file name as source file. Then request target system to process these files based on file name at 11:30 AM. By this way, the order in which XI has processed files is not important.

    Regards,

    Raghu_Vamsee

    Add a comment
    10|10000 characters needed characters exceeded

Before answering

You should only submit an answer when you are proposing a solution to the poster's problem. If you want the poster to clarify the question or provide more information, please leave a comment instead, requesting additional details. When answering, please include specifics, such as step-by-step instructions, context for the solution, and links to useful resources. Also, please make sure that you answer complies with our Rules of Engagement.
You must be Logged in to submit an answer.

Up to 10 attachments (including images) can be used with a maximum of 1.0 MB each and 10.5 MB total.