Hot Folder cronjob not working properly if size of the file getting dropped is big

[Former Member]

One of the problem we are facing in regard of hot folder is that if a large file(size of the file is too big) is being placed then, we have observed that hybris attempts to pick up the file even as the file drop is in flight. This causes the cronjob to essentially not process the incoming file at all. Our complete csv file contains 104304 records but in the cronjob log it shows "62007 records processed".
Is there a way/configuration that can prevent hybris automatically picking up a file until the file transfer is complete?
I have also seen that same problem is raised in wiki also in the below mentioned link: https://wiki.hybris.com/pages/viewpage.action?spaceKey=R5T&title=Hot+Folder&focusedCommentId=2929503...

Any help will be appreciated. Thanks in advance.

[Former Member]

Any update on this. This is a critical issue which I am also facing in my project.

[former_member469962]

Hello Ayan,

What hybris version are you using?

Regards, Shwetha

[Former Member]

hybris 5.5.0

[Former Member]

You can create a folder inside the hot-folder named Temp and star writing the file into it.And just before Program exits move the file from the temp folder to the Main hot-folder. Alternatively,If you are receiving the file from other source you can also write shell-scripts and schedule it to run .Which should copy the file from temp folder to the main Hot-Folder

[former_member469962]

Hi,

You could transfer the file to a different directory on the same filesystem (as hybris) and then copy the fully transferred file to the hot folder for processing. Hope this helps.

-Shwetha

[Former Member]

Is there any configuration that can prevent hybris automatically picking up a file until the file transfer is complete?

[Former Member]

Hi Ayan,

We are facing the same issue. Could you please share the possible solution?

[sreearumilli]

upload file with temp extension.Once the upload done rename the extension back to CSV.