Skip to Content
0
Aug 22, 2023 at 03:56 PM

Record count mismatch between S4 and SAP DI

169 Views Last edit Aug 22, 2023 at 08:04 PM 2 rev

Hi All,

I have two use cases for which I need your help:

  1. While replicating data from S4 to Azure Data Lake using SAP DI in some tables we are noticing data count mismatch between underlying S4 tables and SAP DI. We are replicating the data using CDS views in the source and writing it in CSV format in the target. For e.g. MARA in S4 and CDS view has 100K records but in SAP DI I am seeing only 86K records. I am not adding any transformations ( filters or updating any data mappings) in SAP DI. We checked in other formats e.g. parquet and json and still some data loss occurs. Any thoughts on why the data loss occurs and how can I resolve the same?
  2. I am also noticing that for most of the tables the column length in .sap.partfile.metadata is different than the actual data. For e.g. A column in MARA table might be defined as varchar(5) in .sap.partfile.metadata, but the actual data in the CSV file for that column has more than 5 characters. see below for the metadata file error. Any idea as to why this happens and how can I resolve the same?

image.png

Regards,

Tejas

Attachments

image.png (79.7 kB)