How to Skip the successful dataflow and resume from last terminate dataflow using script..?

[Former Member]

Hi Expert,

I have one requirement in my project let me explain.

Suppose i have 10 data flow in job ex. df1,df2, ...upto df10 and it contain millions of data ,

My job got terminated in df7 so the challenge is in next execution it should skip the all successful dataflow ie, df1 to df6 and start from the df7 which had an error last time.

But using script not using Bypass or recovery options because these job are scheduled by third party scheduler not from BODS management console.

Waiting for your valuable response, Thanks in advance.

[former_member208402 · Accepted solution]

@Tushar

You have to create control in which you can store job run statistics onf DS jobs

columns to have in control table are

Job_run_id

Job_name

Dataflow_name

start_time

end_time

Status

you can add any extra columns if you want and take each dataflow in a conditional.. suppose if you have 10 dataflows take 10 conditional objects and place each dataflow in each conditional and place a script after dataflow and insert a record in to control table after each dataflow completes.

let us know if you need more detailed information on this.

Thanks,

Ravi kiran.

[Former Member]

Thanks Ravi .... Issue is resolved.

[former_member424520]

Hi Tushar,

Could you please share the full flow with script.

[Former Member]

Hi Perimi,

Sorry to say you as i have implemented this all in the client machine so no one have authorisation to copy from there and cant even take a screen shot.

[Former Member]

Thank you so much Magesh for your valuable replay.

could you please tell me more about control table like where i can find this table ?

[mageshwaran_subramanian]

Use the control table (a Database table)

- Place each DF in a seperate conditional

- Insert a record in the control table that indicates whether a DF execute successfully or not.

- At the start the job execution, read the content of the control table to determine whether to execute the DF or not