Data Mapping with Visual Data Mapper (VDM)

Map your warehouse columns to destination tables with RudderStack’s Visual Data Mapper functionality.

The Visual Data Mapper (VDM) offers an intuitive UI to map your warehouse columns to specific destination fields. This is useful especially when mapping your warehouse data to custom fields defined in your destination.

To use this feature, set up a Reverse ETL source and then connect it to a destination that supports VDM.

Supported destinations

RudderStack supports the Visual Data Mapper for the following destinations:

Use Visual Data Mapper

By default, Visual Data Mapping is enabled for all the supported destinations. Click the Map with JSON button to configure the data mappings via JSON.
  1. Select the destination Object where you want to sync the data.

Note that:

  • RudderStack automatically loads all the relevant destination objects. If you have added a new destination object during this configuration process, click Reload objects to get all the latest objects.
  • RudderStack does not support objects that do not have any fields or a unique user identifier.
Select object
  1. Select the sync mode that RudderStack uses to sync your data.

Choose identifier

In the Choose Identifier section, choose a warehouse column and destination field to map your records from the source to the destination. You can choose any column from the dropdown that acts as a unique identifier.

Choose idenfier

The Choose identifier field must have unique values in order to successfully sync the data to the destination. The records containing duplicate identifier values will not sync.

For example, if you have chosen name as the identifier and it contains more than one values like Alex, the duplicate records will fail to sync.

Map fields

In this section, you can configure the specific source-destination field mappings.

  1. Click the Map another field option. Select the Destination field from the dropdown. Then, select the Warehouse column you want to map to this field.
Map objects
RudderStack gives you full visibility into the name and type of the fields that you are mapping along with a sample preview.

Mandatory mappings

There are some required fields you need to map when sending events to some destination objects. These fields cannot be removed from the mappings.

For example, in the Salesforce Account object, Account Name is a required field, as seen in the following image:

Map another field

Map fields of different type/format

If you are mapping fields with different data types or formats, you can use the Transformations feature to do the type conversion before sending the data.

Map another field

In the above example, RudderStack lets you map the warehouse column PHONE of string type to a destination field Associated Company ID of float data type. You can then add a transformation at the destination end to do this type conversion to ensure there is no data type mismatch.

Create custom destination fields

RudderStack lets you create a custom destination field and map it to a warehouse column.

  1. Click the Map another field option.
  2. Enter the name of the custom destination field you want to create.
  3. Click Create.
In some cases, you must create or define the custom fields in the destination before creating them in the RudderStack dashboard.
Create custom fields

Sync data to custom Salesforce objects

RudderStack does not support creating new custom fields for the Salesforce destination using the above steps. However, you can still use the Visual Data Mapper to sync your data to custom Salesforce objects by following these steps:

  1. Log in to your Salesforce dashboard.
  2. In the top navigation bar, click the Setup icon and go to Object Manager.
Salesforce custom object
  1. Go to Create > Custom Object.
  2. Enter the relevant details and click Save to finish the configuration.

Make sure to select the Allow Search setting under the Search Status section, as seen below. Otherwise, the custom object will not be visible in the RudderStack dashboard.

Salesforce custom object
  1. In your RudderStack dashboard, click Reload objects under the Object field. Your newly created custom object should now be visible in this list. Select the object and map the relevant fields to sync your data.
Create custom Salesforce fields

Update mapping configuration


Note the following:

  • You can update your mapping configuration irrespective of whether the connection is turned on or off.
  • While updating the mapping configuration, you cannot change the Object, Sync mode, and Choose identifier fields. You will have to delete the destination and connect a new destination from scratch to do so.
  1. Go to the Schema tab of your Reverse ETL connection page.
  2. Update the mappings as required.
  3. Click Save to update the configuration.
Update JSON mappings

Questions? Contact us by email or on Slack