Hi All, I am currently experiencing the following performance problem using the datahub 5.6.0.8
Database is SAP HANA on seperate db server. Performance configuration guidelines from the wiki are implemented.
When performing a clean restart of the datahub (including CREATE DROP), it performs as expected. One Dataset (for instance MATMAS) gets loaded composed and published in little time. When pushing a lot of datasets (initial load 5000 MATMAS AND CLFMAS), it takes a while as expected. But performance is acceptable. Composition actions are not queuing up, batch sizes and composition and publication times seem to be adequate, heap memory consumption keeps in appropriate limits. After that composition actions are all finished successful and all publication actions as well. Database cleanup extension is activated, thus after the whole procedure is finished, tables are correctly cleaned, RawItems empty, TargetItems empty and CanonicalItems table contains approx. When I triggered 40000 valid items (not too much i reckon) all are stuck for compostion and when i now again push one single MATMAS idoc into the idle datahub, loading and composition takes about no time but publication takes ages. Actually i am currently waiting for over 8 hours and it is not finished yet (and i am not sure if it will at all). The process is running fine (no errors in log) although cpu is pretty much idle. Heap Memory consumption is low. Database is responding fine.
I am using default values
datahub.import.batch.size=1000 datahub.composition.batch.size=1000 datahub.max.composition.action.size=100000 datahub.sql.maxUpdateBatchSize=1000 datahub.publication.page.size=1000
Anyone have any idea?
Regards Vivek