Skip to Content
0

Records processing using Excel as source is taking time

Sep 29, 2017 at 05:36 AM

57

avatar image

Hello Experts,

I'm trying to load the data from excel file to tables but the job is taking around 30-40 mins. Source has special characters in it. Can anyone please help me how to reduce the time taken and improve the performance of job.

Thanks.

10 |10000 characters needed characters left characters exceeded
* Please Login or Register to Answer, Follow or Comment.

2 Answers

Ravi kiran Pagidi Oct 02, 2017 at 08:10 AM
0

HI Rajan Burad,

What is the amount of data in source excel file ? Is it direct execl to table load or do you have any joins/transformations?

Show 1 Share
10 |10000 characters needed characters left characters exceeded

Total records in source excel is around 700000. No joins are present, its a one to one map and one column has a datatype of varchar(4000). However I'll be converting that to long.

0
Samyak Jain Oct 03, 2017 at 02:57 PM
0

Hello Rajan Buard,

Try Degree of parallelism option in Data Flow properties.

Show 1 Share
10 |10000 characters needed characters left characters exceeded

I changed the DOP to 4 but no effect. Job is still taking the same approximate time. :(

0