cancel
Showing results for 
Search instead for 
Did you mean: 

Process dimension with 100 000 elements

Former Member
0 Kudos

Hi guys,

I am currenty trying to develop a package for master data flow for BPC. Members for some dimensions arrive from other external systems.

The problem is that one dimension exceeds 100 000 members.

The question is how to process this dimension?

From Admin Console it takes some 5-6 hours and it seems to be able to process the dimension if I don't select FULL PROCESS.

From my SSIS package the task Make_Dimension with option ApplicationProcess = 0 takes 6 hours and fails. It gives some kind of timeout error.

Are there any considerations on how to make successful process of a dimension with 100 000 members from SSIS?

Thanks.

Best regards,

Valeriy Shylin

Accepted Solutions (0)

Answers (1)

Answers (1)

sorin_radulescu
Employee
Employee
0 Kudos

What version of SAP BPC are using?

It is taking too long.

How many hierarchies do you have for that dimension?

Do you have also dimension formula for that dimension?

How many records do you have into biggest fact table?

What is the configuration of environment where you performed this processing?

We need this information to provide you suggestions about how to improve the processing time.

REgards

Sorin Radulescu

Former Member
0 Kudos

> What version of SAP BPC are using?

We use SAP BPC 7 MS, SP4 I guess. Since I am not the administrator of the application server, I can only guess. Anyway, the release number on the logon window is 7.0.113.

> How many hierarchies do you have for that dimension?

> Do you have also dimension formula for that dimension?

The dimension is flat. It has just 110 000 members with no hierarchies and no dim formulas.

> How many records do you have into biggest fact table?

Actually, we work in the development environment, so the data amount is very limited, some 10 000 rows. Actually, this night I launched the dimension process with clear FACT tables to help BPC process faster.

The result is this (the extract from the package log):

...

12. CreateProduct: Failed in 21,644 sec.

...

- Timeout expired. The timeout period elapsed prior to completion of the operation or the server is not responding. : Location (GetEachParentMembernames)

: Location (MakeMemberLookUp)

To process the dimension I used the Make_Dim task in my SSIS package:

bApplicationProcess = 0

bScheduleProcess = 0

bSecurityProcess = 1

bTakeSystemAvailable = 1

DimensionName = Product

SourceTable = zsaProdBPC

AppSet = ProdsAppSet

UserID is defined in ModifyScript but it seems ignored since I can not find it in the package log. I can see only the AppSet property defined, the one for UserID is missing.

TASK(CreateProduct, AppSet, ProdsAppSet)

> What is the configuration of environment where you performed this processing?

The environment is:

WIndows Server 2003, I don't have any information about its SPs. The Windows' version is 5.2.3790.

SQL Server 2005 Ent. v.9.00.3257.00

4 gb of RAM

If you need any other information just let me know.

Any help or suggestion would be greatly appreciated. We are stuck with this dimension process.

Thanks.

Best regards,

Valeriy