One of the problem we are facing in regard of hot folder is that if a large file(size of the file is too big) is being placed then, we have observed that hybris attempts to pick up the file even as the file drop is in flight. This causes the cronjob to essentially not process the incoming file at all. Our complete csv file contains 104304 records but in the cronjob log it shows "62007 records processed".
Is there a way/configuration that can prevent hybris automatically picking up a file until the file transfer is complete?
I have also seen that same problem is raised in wiki also in the below mentioned link: https://wiki.hybris.com/pages/viewpage.action?spaceKey=R5T&title=Hot+Folder&focusedCommentId=292950310
Any help will be appreciated. Thanks in advance.