Skip to Content
0
Former Member
Jan 18, 2013 at 07:06 PM

Cannot Profile File Data

103 Views

I'm running into an issue where I am not able to profile file data in Information Steward 4.0. I believe this is related to the fact that Data Insight is not returning any rows when I click view data for the specific file that I have loaded. However, I do not receive any error messages as to why the view data is not returning any records.

Here is what I'm doing:

  1. I've created a file format using the actual file I want to load to propose the schema
  2. I've adjusted some of the columns data structures in that proposed schema from int to varchar (I've also left these alone and my results are the same)
  3. I save schema
  4. Add file to the project using the schema
  5. Once file is loaded into the project,
    1. I select the file and view data -> Zero records returned
    2. Try to profile the data -> Failed due to the following message from the log:

Subtask [run id=1] Table WorkFiles on EDM03.DS-US-NewAdds.txt: Dataservices execution failed for (14.0) 01-18-13 13:10:06 (E) (5664:1364) FIL-080124: |Data flow DF_SPF_STATS_427_1|Transform PROFILE_SOURCE1__AL_ReadFileMT_Process The bad row limit for file <//server/WorkFiles/DS-US-NewAdds.txt> is met. The limit specified is <1>.. Error (14.0) 01-18-13 13:10:06 (E) (5664:1364) FIL-080124: |Data flow DF_SPF_STATS_427_1|Transform PROFILE_SOURCE1__AL_ReadFileMT_Process The bad row limit for file <//server/WorkFiles/DS-US-NewAdds.txt> is met. The limit specified is <1>. (COR-10690) (TSK-10008)

I suspect something is wrong with the schema, but I cannot pin point it. Any help would be appreciated.

Tom