Records Missing when loading from datasource into DSO

[Former Member]

Hi

We're loading data from PSA INTO DSO but we're missing nearly 50% records during transformation. Issue is not with key fields as I've tried to add all the fields in the key field but it's same records. By looking into DTP monitor I've founds records are missing from transformation. (picture attached.

Please analyse the code and recommend where you think my records might be missing.

Buffer text tables for reverse look ups

* Job Type

    select txtsh /bic/zjobtype

      from /BIC/TZJOBTYPE

      into table int_zjobtype

     where /bic/zjobtype ne space

       and txtsh ne space.

* Convert all the text values to upper case

    loop at int_zjobtype into w_zjobtype.

      translate w_zjobtype-txtsh to upper case.

      modify int_zjobtype from w_zjobtype.

    endloop.

    sort int_zjobtype.

    move int_zjobtype[] to int_zjobtype_h[].

*Customer

      select txtmd /bic/zpmcust

      from /BIC/TZPMCUST

      into table int_zpmcust

     where /bic/zpmcust ne space

       and txtmd ne space.

    loop at int_zpmcust into w_zpmcust.

      translate w_zpmcust-txtmd to upper case.

      modify int_zpmcust from w_zpmcust.

    endloop.

    sort int_zpmcust.

    move int_zpmcust[] to int_zpmcust_h[].

[former_member220624]

Hi Pawan,

Please check if the 'Handle duplicate records' is checked in the DTP.

Looking at the screenshot exactly 50% of the records are filtered out and i suspect handle duplicate record could be the reason.

Regards,

Amit

[venkatanareshkumar_chittu]

Hello Pawan,

are you using any semantic keys in the DTP? I suspect due to the primary key either in semantic keys or data source is causing this issue. Please check the keys in the data and differentiate as per the combination.

Hope this helps.

Thanks,

Venkata Naresh

[sriramvijay_ravidoss]

Hi,

Even tough you keep all the fields in Key, If there are Multiple similar set of records then they will overwrite.

-Sriram

[aarif_baig]

Hi Pawan,

                code looks fine but still you can twist code a bit and see if it works

* Job Type

    select txtsh /bic/zjobtype

      from /BIC/TZJOBTYPE

      into table int_zjobtype

     where /bic/zjobtype IS not null

       and txtsh is not null.

*Customer

      select txtmd /bic/zpmcust

      from /BIC/TZPMCUST

      into table int_zpmcust

     where /bic/zpmcust IS NOT NULL

       and txtmd IS NOT NULL.

Thanks

[fcorodriguezl]

Hi Pawan,

Your code looks fine.., check

1. DTP Filters

2. Init/Final Routines

3. Transformation maps

3. if your keyfigures are SUM or OVERWRITE.

Regards.

[Former Member]

In addition, check your DSO Key.