Skip to Content
author's profile photo Former Member
Former Member

Migrated/rebuilt Package fails on DumpLoad task with large dataset

We're upgrading to 7.5 for Microsoft from v4.2.

In the new environment we're running SQL 2008 on two Windows 2003sp2 servers

In the old environment we have a DTS package which runs 2xs a day and loads 1million records each run (two months of daily records).

We modified our process and built a new package for 7.5. The new package can load small data sets (60k records) without issue. However attempting the full 1million records, it fails on the DumpLoad task with the following message in Data Manager: "Automation error"

The only thing we find in any log is in the tblLogs where we see:

==============[System Exception Tracing]============== [System

Name] : DumpLoad [Message Type] : ErrorMessage [Job Name] :

RunDumpLoad [DateTime] : 4/11/2011 7:33:16 PM [UserId] :

[Exception] DetailMsg : {Automation error} ==============

[System Exception Tracing End ]==============

Any suggestions or help would be appreciated!

Regards,

KJL

Add a comment
10|10000 characters needed characters exceeded

Related questions

1 Answer

  • Posted on Apr 19, 2011 at 03:07 PM

    The Dump and Load Taks was build actually just for small amount ofa data to be imported less than 100k.

    For large volume of data you can use the conversion task for data validation but instead of dump and load you can use standard bulk import from sql or bulk import task from SSIS.

    Import will be done into wb table followed by a lite optimize or even better a full optimize..

    In this way you will improve load of data a lot, it will be probably 3-4 times faster than using dump and load and the package it will not fail even imporitng 10 million o records.

    I hope this will help you.

    Regards

    Sorin Radulescu

    Add a comment
    10|10000 characters needed characters exceeded

Before answering

You should only submit an answer when you are proposing a solution to the poster's problem. If you want the poster to clarify the question or provide more information, please leave a comment instead, requesting additional details. When answering, please include specifics, such as step-by-step instructions, context for the solution, and links to useful resources. Also, please make sure that you answer complies with our Rules of Engagement.
You must be Logged in to submit an answer.

Up to 10 attachments (including images) can be used with a maximum of 1.0 MB each and 10.5 MB total.