Skip to Content
author's profile photo Former Member
Former Member

Why is "Generate Language for Data Flow" step taking so long?

I am building out a dataflow to read and xml (nested table xsd format) source via an XML_MAP transform and then some downstream query transforms. It seems that when opening and/or saving the dataflow it gets very slow on the "generating language for data flow" step.

Is there any way to speed this step up?

Add a comment
10|10000 characters needed characters exceeded

Assigned Tags

Related questions

1 Answer

  • Posted on Dec 04, 2015 at 01:58 PM

    Make your data flow less complex 😉. Or improve your repository data base connectivity.

    Any object defined in DS Designer is stored in the internal repository tables. Many roundtrips to the database are needed for opening and saving a complex object. There's no way around.

    Dealing with file formats based on large xsd's typically leads to this kind of performance decrease during development.

    Add a comment
    10|10000 characters needed characters exceeded

    • KInd of. When saving, your object definitions have to be writte to the database. When running, the definitions stored in the databse will be read out. It makes no difference if you run a job from the DS Designer or from the console. You'll always have a bit of overhead because of this operation.

      Overhead is lowest when DS and database are on the same (big and powerful enough: cores, memory, disks) machine.

Before answering

You should only submit an answer when you are proposing a solution to the poster's problem. If you want the poster to clarify the question or provide more information, please leave a comment instead, requesting additional details. When answering, please include specifics, such as step-by-step instructions, context for the solution, and links to useful resources. Also, please make sure that you answer complies with our Rules of Engagement.
You must be Logged in to submit an answer.

Up to 10 attachments (including images) can be used with a maximum of 1.0 MB each and 10.5 MB total.