Skip to Content

Identify bad data in the files before job run

Hi ,

We are in the process of job automation, my job is getting failed because extra delimeter or length of a column exceeds.

We should send a notification identify bad data before job process.

Any suggestions.

Thanks,

NAveen

Add a comment
10|10000 characters needed characters exceeded

Assigned Tags

Related questions

2 Answers

  • Posted on Jul 18, 2016 at 05:32 AM

    Best process would be to ask the Business Analyst or the person who sends/puts the CSV file in the shared folder. He/She can validate the file and check for extra spaces, delimiters. He can always open the csv file in an excel file or Notepad++ editor.

    Once he has validated the file then we can peacefully process it in BODS and there would not be any error handling mechanism required. You can still follow the steps for file error handling but it would make your life easier if the file itself is non-erroneous.

    Hope this makes sense

    Regards

    Arun Sasi

    Add a comment
    10|10000 characters needed characters exceeded

  • Posted on Jul 17, 2016 at 05:58 AM

    Hi Naveen,

    Right click on your source flatfile and in error handling set "write errors to file" to Yes and ,give filename with path (captured all he error records during execution) and run the job.. your load completes successfully and you can see all the error records in the file.

    Also use correct column delimited. sometimes, If you are using comma as delimiter and if any record in a field has comma in it then it will separate that record as two and causes delimiter error.

    We also have "use overflow file" in target table options.. This also works same as above.

    I don't think we can identify bad data before the job process.. if you want you have to do it manually digging into your source file.

    Thanks,

    Ravi kiran.

    Add a comment
    10|10000 characters needed characters exceeded

Before answering

You should only submit an answer when you are proposing a solution to the poster's problem. If you want the poster to clarify the question or provide more information, please leave a comment instead, requesting additional details. When answering, please include specifics, such as step-by-step instructions, context for the solution, and links to useful resources. Also, please make sure that you answer complies with our Rules of Engagement.
You must be Logged in to submit an answer.

Up to 10 attachments (including images) can be used with a maximum of 1.0 MB each and 10.5 MB total.