Skip to Content
avatar image
Former Member

Skip Duplicate IDs While Loading Master Data from Flat file

Hello all,

I have a scenario wherein I will have to load the Master Data from a flat file. The load has to happen quite frequently. I have a flat file wherein one of the fields in my flat file has to be loaded to the Dimension ID of one Dimension. The flat file contains multiple records with the same ID. I used transformation file to load the data from a flat file. So when I tried to load the data, it throws me an error that the duplicate records are detected.

Does anyone have any idea how we can skip the duplicate records using transformation file options and mapping section?


Thanuja Sekar

Add comment
10|10000 characters needed characters exceeded

  • Get RSS Feed

2 Answers

  • Oct 23, 2015 at 10:19 AM

    The question is - how you get this file?

    In general it's generated from some system... And the correct way is to generate the version without duplicates directly from the source system.

    Another options are to process the file with duplicates:

    1. Preprocess text file with some script before uploading (vbscript or...)

    2. Use routine badi.


    Add comment
    10|10000 characters needed characters exceeded

  • Oct 29, 2015 at 07:26 PM


    BPC will not load duplicated values it will simply rejects them.  I recommend testing and verifying it, but I think all duplicated records will be rejected.



    Add comment
    10|10000 characters needed characters exceeded