Skip to Content
0

How to commit within a Data Services Dataflow based on a change in the source data

Oct 20, 2017 at 10:36 AM

50

avatar image

Dear Experts,

We are undergoing a migration from Informatica tool to SAP Data Services.

In Informatica there's a transform Transaction_Control which control commit and roll back transactions based on a set of rows that pass through a Transaction Control transformation.

It has been designed like for every group of Order_ID that is processed, the transform will commit the data before proceeding to the next set/group of Id's.

We also have a mechanism of transaction control in data services, but it is not the option that would provide us with this conditional commit feature.

We have tried to loop around the order id's and process them in an iterative manner, but it is time consuming considering that we have around 10-12 million records at source.

Hence looking forward for any solution to this problem that we have.

Thanks,

Iman

10 |10000 characters needed characters left characters exceeded
* Please Login or Register to Answer, Follow or Comment.

1 Answer

Dirk Venken
Apr 06 at 08:26 AM
0

if you're dealing with millions of records, transaction control makes absolutely no sense.

It's not because you have a bad design in one tool, that you have to do exactly the same in another :)

Share
10 |10000 characters needed characters left characters exceeded