Skip to Content
avatar image
Former Member

Records Missing when loading from datasource into DSO

Hi

We're loading data from PSA INTO DSO but we're missing nearly 50% records during transformation. Issue is not with key fields as I've tried to add all the fields in the key field but it's same records. By looking into DTP monitor I've founds records are missing from transformation. (picture attached.

Please analyse the code and recommend where you think my records might be missing.

Buffer text tables for reverse look ups

* Job Type

    select txtsh /bic/zjobtype

      from /BIC/TZJOBTYPE

      into table int_zjobtype

     where /bic/zjobtype ne space

       and txtsh ne space.

* Convert all the text values to upper case

    loop at int_zjobtype into w_zjobtype.

      translate w_zjobtype-txtsh to upper case.

      modify int_zjobtype from w_zjobtype.

    endloop.

    sort int_zjobtype.

    move int_zjobtype[] to int_zjobtype_h[].

*Customer

      select txtmd /bic/zpmcust

      from /BIC/TZPMCUST

      into table int_zpmcust

     where /bic/zpmcust ne space

       and txtmd ne space.

    loop at int_zpmcust into w_zpmcust.

      translate w_zpmcust-txtmd to upper case.

      modify int_zpmcust from w_zpmcust.

    endloop.

    sort int_zpmcust.

    move int_zpmcust[] to int_zpmcust_h[].

Capture.PNG (36.5 kB)
Add comment
10|10000 characters needed characters exceeded

  • Get RSS Feed

5 Answers

  • avatar image
    Former Member
    Sep 15, 2014 at 11:25 PM

    Hi Pawan,

    Your code looks fine.., check

    1. DTP Filters

    2. Init/Final Routines

    3. Transformation maps

    3. if your keyfigures are SUM or OVERWRITE.

    Regards.

    Add comment
    10|10000 characters needed characters exceeded

  • Sep 16, 2014 at 01:29 AM

    Hi Pawan,

                    code looks fine but still you can twist code a bit and see if it works

    * Job Type

        select txtsh /bic/zjobtype

          from /BIC/TZJOBTYPE

          into table int_zjobtype

         where /bic/zjobtype IS not null

           and txtsh is not null.

    *Customer

          select txtmd /bic/zpmcust

          from /BIC/TZPMCUST

          into table int_zpmcust

         where /bic/zpmcust IS NOT NULL

           and txtmd IS NOT NULL.

    Thanks

    Add comment
    10|10000 characters needed characters exceeded

  • Sep 16, 2014 at 05:16 AM

    Hi,

    Even tough you keep all the fields in Key, If there are Multiple similar set of records then they will overwrite.

    -Sriram

    Add comment
    10|10000 characters needed characters exceeded

  • avatar image
    Former Member
    Sep 16, 2014 at 05:59 AM

    Hello Pawan,

    are you using any semantic keys in the DTP? I suspect due to the primary key either in semantic keys or data source is causing this issue. Please check the keys in the data and differentiate as per the combination.

    Hope this helps.

    Thanks,

    Venkata Naresh

    Add comment
    10|10000 characters needed characters exceeded

  • avatar image
    Former Member
    Sep 16, 2014 at 06:41 AM

    Hi Pawan,

    Please check if the 'Handle duplicate records' is checked in the DTP.

    Looking at the screenshot exactly 50% of the records are filtered out and i suspect handle duplicate record could be the reason.

    Regards,

    Amit

    Add comment
    10|10000 characters needed characters exceeded