Any way to replicate existing Data in Same repository

[Former Member]

Hi All,

I have to replicate data existing in Flat Table to Main table in same repository to increase the effectiveness of the solution. Is there anyway to do it without using Import Manager i.e w/o taking the extract of entire data and then importing it to the main table.

Thanks,

Pranav Sharma

[Former Member · Accepted solution]

Hi Pranav,

Please provide detailed scenario.

If that lookup is already linked to Main table then storing the same data in Main table is data redundancy.

Thanks,

Ravi

[Former Member · Accepted solution]

@Ravi

The Main Table was recently modified to store the data of a flat table that is being used to handle large amount of data which is resulting in performance issue. As the main table can hold huge data without any performance issues i have to move the data from flat table to Main table. I am refraining from using the Import Manager as there could be some data miss-match due to extraction and the importing. As the data is really huge, small error could lead to huge complications.

Thanks

Pranav Sharma.

[Former Member · Accepted solution]

Hi Pranav,

This is not that risky even if data is huge.

Take only the primary key VendorId (say) and the lookup out using syndicator or Data Manager.

Map only these in IM,Primary Key for Matching and Newly created text field to replace lookup field.

Set Matching criteria as Primary Key and set action as Update NULL,only field NULL is the newly created field,this will be updated.

If you have doubts,do for a sample data and then go ahead.

Otherwise you can try the same using assignment copying lookup value to newly created field for each record.

Thanks,

Ravi

[Former Member · Accepted solution]

HI,

Is there any linkage between main table and Flat table?

Also what kind of flat table it is?

Regards,

Neethu Joy

[Former Member · Accepted solution]

Hi Pranav,

If you do not want to use IM for updating data in Main Table, then you can do it through Assignments as suggested by Prasad.

But using assignments will have further complications:

1) If the number of fields are large in your table, then you need to write one assignment for every field in the table.

2) As these assignments cannot be executed automatically, then you have to run these assignments manually.

3) Also if system fails to update single record using assignments, whole assignment will fail and no record will be updated. As you described that data is in large amount, so you might face this problem.

So i think the best and easiest way is to use IM for uploading the data.

You can extract data through DM or create map in Syndicator for the same.

Then create Import Map and upload the data in Main table using IM.

Thank you.

[Former Member]

Hello Pranav,

One way to run assignments automatically is through workflows, but again as said above it is a tedious job.

Regards,

Prasad.

[Former Member]

Hi Pranav,

U have to extract data from MDM and use Import Manager.

You can extract data using export functionality in DM or you can use syndicator.

This is the simplest and best way you can replicate data.

Regards,

Neethu Joy

[Former Member]

Hello Pranav,

You can achieve your requirement using Assignments, in case if you do not want to use IM. You need to create assignements for every field of Flat table, which you want to Import into the Main table fields.

Create an assignment Expression on main table Field as below

"Account Group.Code"

TR/- Prasad