Skip to Content
author's profile photo Former Member
Former Member

Joining tables from salesforce.com

I want to read data from a join of multiple tables in salesforce.com. When I build the data flow using a Query transform , the joins are not pushed to the source datastore( salesforce.com). data services reads all rows in each table individually, then performs the join in memory on data services server side.

This causes performance degradation as some tables used in the join have millions of rows. So even for a final output of 10 rows, the job runs for 2+ hrs.

Using pushdown_sql () function in the where clause of the Query transform also does not work.

Using a SQL transform with the whole query does not work as at run time I get error "Unknown reader type 'Adapter'".

Is it possible to push down join criteria for salesforce.com tables. If so, how to do it. I am using 4.2 SP5.

Add a comment
10|10000 characters needed characters exceeded

Assigned Tags

Related questions

1 Answer

  • Posted on Jul 15, 2016 at 05:55 AM

    Better load the SFDC tables in to staging area and do the join(s) in Staging Area. Push down to the database will be very slow as the SFDC Adapter comes into picture and it will slow down the update/insert process.

    Regards

    Arun Sasi

    Add a comment
    10|10000 characters needed characters exceeded

Before answering

You should only submit an answer when you are proposing a solution to the poster's problem. If you want the poster to clarify the question or provide more information, please leave a comment instead, requesting additional details. When answering, please include specifics, such as step-by-step instructions, context for the solution, and links to useful resources. Also, please make sure that you answer complies with our Rules of Engagement.
You must be Logged in to submit an answer.

Up to 10 attachments (including images) can be used with a maximum of 1.0 MB each and 10.5 MB total.