Skip to Content

SFTP sender channel processing issue

Hello Experts,

I have an issue with SFTP sender channel. I can see the file processing through SFTP is a bit low than regular processing.

Processing mode: EOIO, duplicate file handling enabled, archiving file on sftp server. file size is 1.3KB

it is processing 10-12 files in a minute and i have a huge backlog now on directory.(more than 5k files), it is keep on getting increased as getting more number of files from application.

Could anyone please let me know the normal SFTP adapter processing count?

Also, it is running with only one node as it is not relocating to other node. Is this expected behavior ? whats the reason behind this?

Please let me know if there is anyway to accelerate the file processing . Thanks in advance!!



Add a comment
10|10000 characters needed characters exceeded

Related questions

2 Answers

  • Posted on Jul 15, 2020 at 01:56 PM

    Hi Gaurav ,

    I don't think there is the limit in no of file processing by SFTP adapter at a time , and also the file processing should be distributed across all available server nodes . have you tried restrating channel and adapter once.



    Add a comment
    10|10000 characters needed characters exceeded

  • Posted on Jul 16, 2020 at 09:19 AM

    My 2 c

    • EOIO could be reason why it is working on one server node only. However, I only have a JMS and a custom adapter FTPAM EOIO scenario runnig where one could explicitelly specify a server node (JMS) or where the adapter implicitely just choses one server node (FTAM). So YMMV. Try EO and see if both nodes are utilized
    • do you really need the duplicate check? try to turn it off and see how it relates to performance
    • is archiving mandatory you have the files within PI through staging already (most probably) so turn it off and see how this relates to performance
    • have a look at dynamic queues (this may help reliefing some locking / holding situations)
    • have a look at the plethora of perormance tuning guides. Your throughput is generally so low that there must be some major roadblock



    Add a comment
    10|10000 characters needed characters exceeded

Before answering

You should only submit an answer when you are proposing a solution to the poster's problem. If you want the poster to clarify the question or provide more information, please leave a comment instead, requesting additional details. When answering, please include specifics, such as step-by-step instructions, context for the solution, and links to useful resources. Also, please make sure that you answer complies with our Rules of Engagement.
You must be Logged in to submit an answer.

Up to 10 attachments (including images) can be used with a maximum of 1.0 MB each and 10.5 MB total.