Data Services Designer slowness

[Former Member]

Hi, We are using SAP Data Services XI 3.2. The designer takes a very long time for the jobs that have "Data Cleanse" transforms in it. If the number of 'Data Cleanse' transforms is more in a job, the time designer takes to load the job and display increases. Approximately, it takes 10 mins for a real time/batch job that has one Data Cleanse transform in it. Could anyone let us know what could be cause of this?

[Former Member]

Hi Kathiresan

For performance of data Quality transforms, You can go to the wiki link

http://wiki.sdn.sap.com/wiki/display/EIM/Data+Quality+Transforms

[Former Member]

Hi Kathiresan,

Use MAP_OPERATION transform before loading into the target table.It increases the performance compared to the previous one.

Thanks,

Murali

[Former Member]

Hi Murali, Suraj

Thanks for your response.Sorry for my delayed response. The problem is not with the Data Cleanse transform's performance while executing a job. The problem that i face is with the designer opening up a job slowly and showing it up for us to edit when there is a Data cleanse transform used in a job. The time it takes to open the job increases based on the number of Data Cleanse transforms i have in the job.

For Eg. If I've three real time jobs as mentioned below,

Real Time Job 1 - 2 XML Messages (1 Input & 1 Output), 1 Query Transform and 1 URAC

Real Time Job 2 -  2 XML Messages (1 Input & 1 Output), 1 Query Transform, 1 URAC and 1 Data Cleanse

Real Time Job 3 - 2 XML Messages (1 Input & 1 Output), 1 Query Transform, 1 URAC and 5 Data Cleanse

For the designer it takes,

1 min (approx) to open the first job (Real Time Job 1).

5 mins (approx) to open the second job (Real Time Job 2).

25 mins (approx) to open the third job (Real Time Job 3).

Could you please let me know what could be the cause of this issue?

Thanks,

Kathir

[paula_augedahl]

Kathir,

I suspect the following may be what you are encountering.

The first time a parser is used on a system, there are performance dictionaries copied to the local system.  Changes also cause the info to be recopied.  Once it's copied (and given that there are no changes made to the cleansing package), the next time you open a Data Cleanse using that parser, e.g. Person_Firm_EN, on the same system, it doesn't need to redownload the performance files.

In your case, I wonder if your various Data Cleanse transforms are referencing different country's Person_Firm_<country> parser. If so, let it do its thing to transfer the files.  Try closing out and coming back in to the same job.  If the issue is this performance dictionary copy, I am thinking you shouldn't see this the second time.

Hope this is helpful.

Thanks,
Paula

[Former Member]

Thanks Paula.

Yes, i'm using Person_Firm_<country> parser, where <country> changes in the different Data cleanse transforms that i have in my job. But, even in the same system, after loading once and if i close the designer and open it again, when i try to open the job, it loads everything again and takes the same time as it took to load for the first time. Can you please let me know if there is any option i need to change in designer for that?

Thanks,

Kathir