Load Data from CSV File

[Former Member]

I just loaded a CSV file and It said it was successful but I don't see all the data at the appropriate intersections. 

I set it up to overwrite records with matching key and to aggregated the data before load.

When reviewing the log file below I noticed that the aggregate count was 19503,  when I pivot the data the aggregate count comes to 47777 when I exclude data that was already in the cube i come up with aggregate records of 46384.    I am hoping that someone can help me understand why it says all records were accepted and the package ran successfully yet the data is not where I would expect it.

Thank you in advance for you patience.

/CPMB/MODIFY completed in 0 seconds

/CPMB/CONVERT completed in 5 seconds

/CPMB/LOAD completed in 20 seconds

/CPMB/CLEAR completed in 0 seconds

[Selection]

--------------------------------------------------------------

FILE = \ROOT\WEBFOLDERS\SFG_EXP\EXPENSE\DATAMANAGER\DATAFILES\EXPENSE00006.csv

TRANSFORMATION = \ROOT\WEBFOLDERS\SFG_EXP\EXPENSE\DATAMANAGER\TRANSFORMATIONFILES\EXPENSE_TRX LOAD3.xls

TARGETMODE = Yes

PREPROCESSMODE = No

RUNLOGIC = Yes

CHECKLCK = Yes

[Message]

--------------------------------------------------------------

Task name CONVERT:

No 1 Round:

Reject count: 0

Record count: 48494

Skip count: 0

Accept count: 48494

Task name LOAD:

Aggregate count: 19503

Submit count: 28991

Reject count: 0

[Former Member]

Hi Nick,

Does each column in your CSV have a dimension in your model?

Also does each line in your CSV represent an unique intersection?

If not then there will be aggregation taking place while you load data.

Andy

[bishwajit_das]

Hi Nick,

Check the total aggregated value of the SIGNEDDATA of the records is equal to what you expect.

If you think something is wrong, take a small sample set of data(10-20) and check overwrite records with matching key functionality..if you find it works well and go forward with the complete records.

With your sample data, you can test it properly. And as BPC is not giving any error.So, its quite difficult to suggest any solution without looking into your complete set of records.

Wish you can try looking at a small segment of data..

Regards,

Bishwajit

[former_member186338]

Hi Nick,

You have to look on and compare Submit count!

For the rest - please recheck, the data is in the cube...

Vadim