Skip to Content
0

BODS using AWS Redshift as a target | SLOW

Jul 28, 2017 at 07:53 PM

78

avatar image
Former Member

I am trying to send the data from SAP HANA to Redshift using SAP BOSE 4.2

The source table has closed to million rows and it is taking forever to load the data into the Redshift table. What are my options to expedite the process?

The one I can think of is using S3 to move data in Hana as CSV files and using copy command, the data can be moved faster but how do I establish an S3 connection with BODS? How to make CSV files using BODS

PS: I plan to use CDC for incremental loading.

10 |10000 characters needed characters left characters exceeded
* Please Login or Register to Answer, Follow or Comment.

2 Answers

avatar image
Former Member Jul 28, 2017 at 09:49 PM
0

Hi

What version of DS are you on? Version 14.2.8.1437 gives you a bulk loader for RedShift. See the note 2414707 - Release Notes for SAP Data Services 4.2 Support Pack 8 Patch 1.

For us, it has increased the speed a lot.

Best regards

Share
10 |10000 characters needed characters left characters exceeded
avatar image
Former Member Oct 11, 2017 at 06:07 PM
0

Hi Kanav,

I am working on a POC to connect SAP with Redshift. I am wondering if you looked at Matillion for extraction, did you have any roadblocks with Matillion.

I am new to Matillion. I have used SAP BODS and I am familiar with the capabilities of SAP BODS. Let me know if you tried Matillion and if yes please share your experience.

Poonam

Share
10 |10000 characters needed characters left characters exceeded