RudderStack Transformations Overview

RudderStack Transformations allow you to code custom JavaScript and Python functions to implement specific use cases on your event data. Transformations run in real-time, after data collection and before delivery to a destination. You can use them on any data you send through RudderStack – via Event Stream, ETL, or Reverse ETL pipelines. Transformations enable a variety of use cases, such as:

  • Filtering/sampling events
  • Enriching events
  • Cleaning/aggregating data
  • Data masking or removing sensitive PII information
  • Implementing external actions on events using an API

Transformation templates and libraries

Every transformation you write is reusable. When you write a transformation once for use in a specific destination, it’s made available for use across all of your other destinations. Transformations are also modular – you can save your transformation code in a Transformation Library to reuse in other transformations.

RudderStack also provides over 18 prebuilt transformation templates, so you don’t have to start from scratch for common use cases.

Transformations API

You can build and manage your transformations using your existing workflow via our Transformations API. The Transformations API enables you to programmatically create, read, update, and delete transformations and libraries by making HTTP calls. It also gives you the flexibility to reuse and maintain different versions of your transformation code.

With the Transformations API, you can:

  • Programmatically add and remove transformations to your platform via HTTP API calls
  • Create an organization-wide sandbox where your team can store transformations
  • Define Libraries
  • Version Control your transformations
  • Publish multiple Transformations in a single operation
  • Check for successful compilation and execution of new transformations

Transformations use cases

Because of the inherent flexibility of Transformations, you can use them to implement a wide range of use cases based on your business requirements. Write custom transformations to handle specific requirements, or use one of our transformation templates to handle common use cases. Use cases fall into four broad categories:

  • Data cleaning
  • Data privacy
  • Data enrichment
  • Data filtering

Below, we’ll detail some of the most common use cases for transformations and provide the corresponding templates.

Data cleaning

Transformations provide a powerful mechanism for cleaning your event data before it reaches its destination. You can use our prebuilt data cleaning transformations to:

Data privacy

Transformations allow you to replace or mask any sensitive data in your payloads on a per-destination basis. You can use our prebuilt data privacy transformations to:

Data enrichment

Transformations allow you to automatically enrich your events with other available data from internal and external APIs. You can use our prebuilt data enrichment transformations to:

Data filtering

Transformations make it easy to filter your event data in flight so that only relevant, necessary data reaches each destination. You can use our prebuilt data filtering transformations to:

Check out our Transformation Templates documentation for a complete list of prebuilt templates. While these cover common use cases, the applications for Transformations are extensive. You can create transformations from scratch to solve for your unique business requirements.

Demo and additional resources

Embed video:

Visit the following links for more information on RudderStack Transformations: