Import from flat file with n columns

[Former Member]

I have a CSV flat file representing survey results that currently has about 75 columns. In the future, the business may want to add additional questions to the survey, so I may end up with more columns that will need to be imported. Is there any way to automatically incorporate the added columns in existing data flows? Or do I have to update the Flat File Format whenever a column is added? All columns are the same datatype.

[former_member106536 · Accepted solution]

You can define the format with a couple hundred columns then use the adaptable schema option in the reader to allow for the fluctuations.  You would just want to put in some solid validation to ensure there isnt an issue with your base record.

When we image surveys, they get sent to me as multi-line fixed length records.     The cobol copybook refuses to perish.

[former_member198401 · Accepted solution]

Hi Brian,

Never used this option.

As Joshua suggested, you can add couple of extra columns in the file format and set the option Adaptable schema to Yes.

Regards

Arun Sasi

[former_member198401]

Hi Brian,

Unfortunately there is no other way to automatically add the columns. You will have to update the columns in File Format editor only.

This is by design.

Regards

Arun Sasi