Skip to Content
avatar image
Former Member

Load Data from CSV File

I just loaded a CSV file and It said it was successful but I don't see all the data at the appropriate intersections. 

I set it up to overwrite records with matching key and to aggregated the data before load.

When reviewing the log file below I noticed that the aggregate count was 19503,  when I pivot the data the aggregate count comes to 47777 when I exclude data that was already in the cube i come up with aggregate records of 46384.    I am hoping that someone can help me understand why it says all records were accepted and the package ran successfully yet the data is not where I would expect it.


Thank you in advance for you patience.

/CPMB/MODIFY completed in 0 seconds

/CPMB/CONVERT completed in 5 seconds

/CPMB/LOAD completed in 20 seconds

/CPMB/CLEAR completed in 0 seconds

[Selection]

--------------------------------------------------------------

FILE = \ROOT\WEBFOLDERS\SFG_EXP\EXPENSE\DATAMANAGER\DATAFILES\EXPENSE00006.csv

TRANSFORMATION = \ROOT\WEBFOLDERS\SFG_EXP\EXPENSE\DATAMANAGER\TRANSFORMATIONFILES\EXPENSE_TRX LOAD3.xls

TARGETMODE = Yes

PREPROCESSMODE = No

RUNLOGIC = Yes

CHECKLCK = Yes

[Message]

--------------------------------------------------------------

Task name CONVERT:

No 1 Round:

Reject count: 0

Record count: 48494

Skip count: 0

Accept count: 48494

Task name LOAD:

Aggregate count: 19503

Submit count: 28991

Reject count: 0

Add comment
10|10000 characters needed characters exceeded

  • Get RSS Feed

3 Answers

  • Dec 23, 2014 at 06:13 PM

    Hi Nick,

    You have to look on and compare Submit count!

    For the rest - please recheck, the data is in the cube...

    Vadim

    Add comment
    10|10000 characters needed characters exceeded

  • avatar image
    Former Member
    Dec 24, 2014 at 07:02 AM

    Hi Nick,

    Check the total aggregated value of the SIGNEDDATA of the records is equal to what you expect.

    If you think something is wrong, take a small sample set of data(10-20) and check overwrite records with matching key functionality..if you find it works well and go forward with the complete records.

    With your sample data, you can test it properly. And as BPC is not giving any error.So, its quite difficult to suggest any solution without looking into your complete set of records.

    Wish you can try looking at a small segment of data..

    Regards,

    Bishwajit

    Add comment
    10|10000 characters needed characters exceeded

  • avatar image
    Former Member
    Dec 24, 2014 at 07:46 AM

    Hi Nick,

    Does each column in your CSV have a dimension in your model?

    Also does each line in your CSV represent an unique intersection?

    If not then there will be aggregation taking place while you load data.

    Andy

    Add comment
    10|10000 characters needed characters exceeded