on 07-16-2018 2:33 PM
Hi experts ,
I was trying to extract ODATA service data from ECC and load it to HANA table using BODS .The data is getting duplicated at both source as well as destination i.e from entitySet table to Hana table but If I select distinct rows in the query transform I am able to see unique record in the query transform whereas in target again it gets duplicated. Please find the attached screenshot.
Please help me where I am going wrong
Thanks in advance.
Regards,
Vinaya
.
Have you been able to confirm if there are duplicate records from the source ECC table?
Can you also confirm if the Degree of Parrelisim of the dataflow is set to 1, to limit the process threads to 1 instead of the default 2?
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Thank you for confirming the source did not have duplicates.
You change the default Degree of Parellisim from the Dataflow properties as needed, or to effect the whole job design you would change it in the DSConfig.txt Global_DOP switch.
After you changed the DOP, did you execute the job again and what were the results?
Can you also provide what the following versions:
Data Services
Information Platform Services
Job server OS
Because the DSConfig.txt file edits and effects the performance of any job executed on the job server, we only recommend changing the file properties as needed.
For now please change the DOP at the job design/dataflow level and test.
Can you please confirm if the duplication is resolved and your versioning?
Management Console would have most of the same execution options set as well.
How is the Target table set in Designer? are there multiple loaders set, set to drop and delete contents of the table each load or set to retain them?
In the Monitor log screen in Designer, during execution how many records are shown to load?
Vinaya,
Thank you for the update and the workaround.
I have recently found the following KBA 2310626, which lists that duplication can occur from ECC tables when a setting in set in the Application Attributes.
https://launchpad.support.sap.com/#/notes/2310626
If this error occurs again please feel free to log a support ticket.
From the SAP Designer Guide : Row_Generation Generates a column filled with integer values starting at zero and incrementing by one to the end value you specify. The incoming data of one record is being assigned a temporary row id that overrides the duplication behavior from the source object.
Again this appears to be a workaround that is vaild for this time, but for deeper troubleshooting of the root cause, a service ticket will need to be created.
User | Count |
---|---|
80 | |
24 | |
11 | |
9 | |
7 | |
6 | |
5 | |
5 | |
4 | |
4 |
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.