Skip to Content
author's profile photo
Former Member

Data Transfer Workbench Slow on Large Imports

I am using version 6.5.11 of the workbench, API version 6.50.53

I have a problem with the speed of imports where the file sizes become large. e.g. I am importing sales invoices using a header file and line items file. Both are tab-delimited text files. If I import 2000 invoices, it takes around 1.8 seconds per invoice. If I import 10000 invoices, it takes around 18 seconds per invoice (50 hours). I actually wanted to import around 30000 invoices, but that was taking a minute per invoice.

Another problem is that the first data line after the header line in every import file is ignored and not processed.

Does anyone know if these have been fixed or will be fixed soon?

Add comment
10|10000 characters needed characters exceeded

  • Follow
  • Get RSS Feed

1 Answer

  • author's profile photo
    Former Member
    Posted on Aug 19, 2004 at 01:31 AM

    To import a large amount of items or invoices with the Data Transfer Workbench, I always shrink the file into x files with 1000 records. That's the only to have a fast process.

    Apparently this problem is correctedwith 2004 which is much faster. I haven't tested yet the DTW with 2004 as I just received it.

    For the bug you have with the line, it occured to me one time too but not anymore and I can't work out why it did that. Maybe, it could be more efficient for you to create message on the marketplace.

    Vincent

    Add comment
    10|10000 characters needed characters exceeded

    • Former Member Former Member

      FOr the data transfer, we usuallu do that over the week end when the company does not work. If the company works 24/24h, I suggest you choose the time when the production is at the lowest level and then transfer.

      If you do it with 3 DTW clients, your should be able to import your records quickly.

      Vincent