DTP between two standard DSOs finishes at inconsistent timings.

[former_member589026]

Hello all,

As part of our daily data load process, the final stage is to data transfer all the active contents of our DSO1 to DSO2 (both standard). There's no issue in the transfer of data(We insert around 1.5 million records everyday from DSO1 to DSO2 and this number won't change much daily apart from an increase of few 1000s from the previous day).

Coming to the issue, the time taken for completion differs drastically everyday. For example, the DTP on 2.08.2018 inserted 1,612,223 records and took 6 hours to finish it. However, the day before, the same DTP inserted 1,607,410 records but took only 1 hour and 2 mins.

I did my work to see this link on tips to increase the performance. But my project is using all the recommended settings and more over, the issue occurs not on a daily basis, but on random days.

I drilled down a bit more and kind of narrowed down the issue. some of the packages takes around 1, 2 or even 3 hours to complete because of the end routine step under the transformation.

Link referred

https://help.sap.com/saphelp_nw70ehp2/helpdata/en/47/e8c56ecd313c86e10000000a42189c/content.htm?no_c...

Info needed:

1) What could possibly be the issue, that on a day, the DTP transfers all the data at around 1 hour but on the very next day it took 6 hours? (As I type, it's running for around 8 hours today)

2) Is there any way where I can see, what's causing the bottle neck? (like a task manager or something? Kindly help me out on this)

3) just an additional doubt from me: Does the number of parallel processes amounts to number of packages that are processed simultaneously?

DTP settings:

Extraction type: Serial extraction, Immediate parallel processing.

Extraction from: Active data

Number of parallel processes: 3

Package size: 50000

[matt]

"some of the packages takes around 1, 2 or even 3 hours to complete because of the end routine step under the transformation."

Ok... so you know the cause of the issue - an inefficient end routine - so what's the question?

[Former Member · Accepted solution]

check TCode : RSREQREDUCE and look for your DSO... If the number of requests are more in your DSO, it will effect the load times.. I am not sure if this is the problem in your case , but it is worth a shot. Hope this helps..!!

[former_member589026]

Hi all,

Looks like the problem is with the data, that's being picked up daily. While processing the end routines, it's eating up so much time. We are not working on this issue anymore as it's out of our scope. Thanks for the responses anyways.