SAP Data Services Code Page Issue.

[venkataramana_paidi]

Hi ,

I have  different source systems with MSSQL server database.

I have one database with Arabic_CI_AS and another database with SQL_Latin1_General_CP1_CI_AS.

That's why we created the staging database and DWH layer with UTF-8 ( Sybase IQ).

For the source( MS SQL) I have created the data store with :

Language : Arabic (ara)

Code Page : CP1256

Sever Code Page : UTF-8

My Target database ( Sybase IQ) for both schemas ( Staging & DWH) settings are below:

Language : Arabic (ara)

Code Page : UTF-8

Sever Code Page : UTF-8

But after loading the data into the staging target table I can see the data  from table view but If i want to see from the Sybase IQ interactive sql tool , I am getting junk characters. I tried to load the staging loaded data into the DWH layer  In this case  both table view and interactive sql , I am seeing junk characters only.

If I try to load with bulk load option then I can see the data in interactive sql but I cannot see the data in the view table option.

Because of this issue I am unable to load any table into my DWH layer.

It is very urgent.

Please help me to resolve this issue.

Thanks & Regards,

Ramana.

[former_member355411]

We had the same issue. We also have an utf-8 SAP IQ database as target.

For us, the solution was the following.

1. Use a DSN (ODBC) instead of a direct connection for your SAP IQ datastore;

2. While creating the ODBC, go to Advanced and change the value Charset to utf-8

Hope this helps

[former_member198401]

Hi Ramana,

What is the Collation of the database schema for DWH Layer

Can you check with the collation 1256ARA if it is feasible for the database

Regards

Arun Sasi

[venkataramana_paidi]

Hi Arun,

For the Staging and DWH schema both are on single database. Code page set to UTF-8 for whole database.

Thanks & Regards,

Ramana.

[former_member198401]

Can you check with the Sybase DBA for the Collation on this database(Staging and DWH)

I guess UTF-8 wont be enough for Arabic characters

Regards

Arun Sasi

[venkataramana_paidi]

We have tried direct inserts , It is inserting and we can view the Arabic data.  We can load from bulk load method from source to staging and view the data from IQ database side but not from the DS table view.

Thanks & Regards,

Ramana.

[former_member198401]

Not tried though. Can you try changing the Preferred viewing locale under Tools/Options/Designer/Language in Designer and try to View Data

Regards

Arun Sasi

[venkataramana_paidi]

I have change and tried that option also no result.  Still I am facing same result.

[venkataramana_paidi]

I have changed the  SAP DS Locale  also to UTF-8 and Arabic as shown below. But still problem is not resolved.

[venkataramana_paidi]

Hi ,

I have tried below combinations also  but the result is the same  for all the combinations.

Please find the below screenshot.

Thanks & Regards,

Ramana.