Is it possible to read variable length records in DS? I have been told that the source files we get may from time to time have new fields added to the end of the file (and no one will tell us this until after it has happened). I am currently using file formats which explicit define the file layout so DS can parse the file. My files have pipe delimited fields and end of record markers.
I'm sure if new fields are added to the end of the file, the job will fail since the file format does not match the number of fields included in the record.
Is there a way to read the file even though fields are added?