special character issue

[svelpula]

Hi

We are not getting special characters from legacy system(oracle database) for instance Material description Lötöse M3 coming as Lotose M3 to out staging database. Please find the attached document for your reference.
I tried to change the DSConfig.txt file with the below parameter AL_Engine=<default>_<default>.utf-8,still issue is not resolved. Appreciate your quick help! Srikanth Velpula

[vnovozhilov]

The main idea is to understand on which stage of ETL (Extract, Transform, Load) process you are losing special characters.

The simple test could be this: create a flatfile format with UTF-8 codepage as a target - would you be able to load special characters in there? If so, the problem is not with reading or processing but with loading into target, therefore you need to check client settings and target datastore settings.

What is target?

Thank you,

Viacheslav.

[svelpula]

Hi Viacheslav,

We are not able to load them in flat file also we are losing special characters during the extraction only

ThankYou

Srikanth Velpula

[Former Member]

If UTF-8 flat file does not show the special characters, please look at the post below for how to handle special characters. Basically, the target data store and the setting in the DSConfig file need to be set to utf-8.

In addition as mentioned below, also check the entries for NLS_LANG.

Data Integrator example - Enterprise Information Management - SCN Wiki

Cheers,

Chaitanya

[vnovozhilov]

Check NLS parameters in your Oracle db and set NLS_LANG correspondingly on Job Server machine. If the issue persists, please share aforementioned details.

Thank you,

Viacheslav.

[DayaJha]

Hi Velpula,

This is related to codepage issue, So we have to check below pointto debug the issue:

(a) Have you done the changes in DSConfig.txt?: As you already mentioned you have updated the details.

(b) Target System of Jobs

Thanks,

Daya