Normalisation of text string on import through import manager

[Former Member]

Hi There, we have just uncovered an issue with our workflows where a submitted file that contains 'special' characters in a description field (text string) will cause the jobs to fail. Is there a way i can tweak the normalisation feature in the import manager to remove these special characters, while leaving 'normal' characters (such as spaces, commas and other punctuation) in tact?

[Former Member · Accepted solution]

Hi Adam,

The failure is happening at the import stage and not the workflow stage ,As your import of records are triggering the workflow action(Trigger action being record Import).The records may not be getting imported rightly and so the workflow failing.

But as far as i know the Text data type in MDM allows special characters entry without much problem.

Try the following:

- Check to see if the charater length of this special characters holding field is sufficiently large it could be the problem that the length of the incoming charaters are more than the length mentioned in the console settings and so truncation of charaters are causing the failure of import.

- Check to see if values of all other fields especially the date and numeric fields if any are holding correct data .

- Lastly if you find out that the special charaters are the only cause of the failure then you will have to perform the normalization of the values and save the settings in the map and then use this saved map.Try to accomodate all the possible charaters faults.You can normalize the Field by right clicking on it and say value conversion filter >Normalize.If your values are lesser you can normalize them at the value level itself using the right click.

Hope It Helped

Thanks & Regards

Simona Pinto

[Former Member · Accepted solution]

When i normalise that field, it removes all spaces and commas etc as well. This field is a description field for a product record and therefore, the spaces etc are definately required. Is there a way where i can control what characters are 'normalised'. Typically, only those characters in the extended ascii set would need to be normalised, 0 -> 128 would be fine.

[Former Member · Accepted solution]

Hi Adam

After doing field mapping apply value converter and use replace function to replace all the special characters with balnk. this should be able to meet your requirement.

Thanks

Ravi

[Former Member]

Hi Adam,

Yes we have Normalize feature available in Import Manager. Perform the field mapping first and now right click on the field to be Normalized and select Set Value Conversion Filter -> Normalize. This would be applied to all the field values.

Regards,

Jitesh Talreja