cancel
Showing results for 
Search instead for 
Did you mean: 

Error -- Publication Data is not importing immediately when using CSV Web Service Extension

former_member664713
Active Participant
0 Kudos

Hi All, I written one cron job to read the CSV file from data directory. In cron job implementation I am calling the service for Raw item , canonical and publication as follows.

POST - http://localhost:8080/datahub-webapp/v1/data-feeds/DEFAULT_FEED/items/RawProduct and

POST - http://localhost:8080/datahub-webapp/v1/pools/GLOBAL/compositions and POST - http://localhost:8080/datahub-webapp/v1/pools/GLOBAL/publications

Sometimes The product is coming immediately but some times it is not processing immediately product data. At that time I am getting the publication status success from the response. The records are inserting in the Raw Item, Canonical but not In the publication table and also there no record in the publication error and publication retry table also.

How to process the data immediately when I run the cron job using CSV Web Service Extension

Thanks

Accepted Solutions (0)

Answers (1)

Answers (1)

former_member224482
Active Contributor
0 Kudos

Check if the feed is completed before triggering the composition.
Check if the composition is completed before triggering the publication.

You can do GET requests on the feed and composition to know their status. Continuously do GET requests until the status is not IN_PROGRESS.
You can also write event listeners on the data hub to be more immediate on triggering the next transformation phase.

former_member664713
Active Participant
0 Kudos

Thanks , I am getting the status SUCCESS every get request in feed , composition and publication. check the attachments !

I am getting the status like, but the records are not processed in to target.

former_member664713
Active Participant
0 Kudos

Hi , How to call Publication event as soon as composition event complete ?