Skip to Content
0

SAP IQ 16 and Hadoop

Oct 21, 2016 at 02:04 PM

105

avatar image

Hello,

Using SAP IQ 16 and Hadoop independently, the need is to move data from some tables in IQ to Hadoop periodically. i.e like using "incremental data loads from IQ to Hadoop".

An idea is to extract the data from IQ to Unix flat files an then process them with "awk" in order to load the difference between the last extraction file and the current into Hadoop.

Do you know if there is any tool that can do something like this ?

Thank you

Regards

Jose

10 |10000 characters needed characters left characters exceeded
* Please Login or Register to Answer, Follow or Comment.

3 Answers

Eisen Wang
Oct 24, 2016 at 02:03 AM
0

Do you mean iqunload?

Share
10 |10000 characters needed characters left characters exceeded
Volker Stöffler Oct 24, 2016 at 12:19 PM
0

Hi Jose,

To write query results to files (IQ serer side), you may use the TEMP_EXTRACT_* set of database options

[http://help.sap.com/saphelp_iq1608_iqrefso/helpdata/en/a6/2adda484f21015b5a6aea48ec128cf/content.htm]

HTH

- Volker

Share
10 |10000 characters needed characters left characters exceeded
Jose Torres Oct 24, 2016 at 01:38 PM
0

Hello Guys,

Thank you. I found info on Apache Sqoop which might do the job, because we need to extract only the data ( from user tables) which has changed since the last extraction date.( that's why the analogy of an "incremental backup", but in this case just data from user tables).

Regards

Jose

Share
10 |10000 characters needed characters left characters exceeded