Transformation Libraries

RudderStack’s transformation libraries feature lets you reuse the same code in multiple transformations.

RudderStack now supports writing transformation libraries in Python for the RudderStack Cloud Growth and Enterprise plans.

Add transformation library

1. In the RudderStack dashboard, go to Collect > Transformations and click the Libraries tab. Then, click Create Library.

2. Add the library Name, Description and select the language to write the library function. You can also add multiple functions in a single library.

RudderStack supports Python libraries only in the RudderStack Cloud Growth and Enterprise plans.

3. Click Run Test to ensure the library code has the correct syntax. A Test Passed message pops up once the test runs successfully.

Use libraries in transformations

RudderStack provides some default libraries that you can import in your transformations for implementing various use cases like encrypting, decrypting, or hashing PII, parsing user agent, and using the localized version of Apple’s device mode information in your events.

See Default RudderStack libraries for more information.

To use the libraries in your existing transformations, note the library name listed in the Import library name column in the RudderStack dashboard:

RudderStack converts the library name into camel case without spaces; this becomes your library handle which you can use across multiple transformations. For example, if your library name is Sample Transformation Library, then the library handle would be sampleTransformationLibrary.

You can then use the library in a transformation with a simple import statement. Refer to the below use case for more information.

Use case

Suppose you want to filter the events that don’t contain an email address with the RudderStack domain. To do so, you can import a rudderEmail function from the transformation library isRudderEmail.

The rudderEmail function containing the filtering logic is shown below:

export function rudderEmail(email) {
    return /@(rudderlabs|rudderstack)| \+ruddertest/.test(email);
}

import re

def rudderEmail(email):
  match = re.search('@(rudderlabs|rudderstack)|\+ruddertest', email)
  if match:
    return True
  return False

The following snippets demonstrate how you can import this function in a transformation:

import { rudderEmail } from "isRudderEmail";
export function transformEvent(event) {
  const email =
    event.context && event.context.traits && event.context.traits.email;
  if (email) {
    if (!rudderEmail(email)) return;
  }
  return event;
}

from isRudderEmail import rudderEmail

def transformEvent(event, metadata):
    email = event.get("context", {}).get("traits", {}).get("email")
    if email:
        if not rudderEmail(email):
            return
    return event

On clicking Run Test, a sample event not containing the RudderStack email domain is filtered out:

Import multiple functions from single library

The following snippets highlight how to correctly import functions from a library:

// ---------------
import { getLoss } from "getFinanceData";

// OR

import { getLoss, getRevenue, getProfit } from "getFinanceData";
import {
  getLoss,
  getRevenue,
  getProfit
} from "getFinanceData";

// For default getPrice import
import getPrice, { getRevenue, getProfit } from "getFinanceData";

// alias imports
import getPrice as gp, { getRevenue as gr, getProfit } from "getFinanceData";
// usage: gp(event), gr(event), getProfit(ev)

import * as GFD from "getFinanceData";
// usage: GFD.getRevenue(ev), GFD.getProfit(ev)
// for default import: GFD.default(ev)

from getFinanceData import getRevenue, getProfit
// usage: getRevenue(event), getProfit(event)

from getFinanceData import getRevenue as gr, getProfit
// usage: gr(event), getProfit(ev)

import getFinanceData
// usage: getFinanceData.getRevenue(event), getFinanceData.getProfit(event)

The following snippets highlight the incorrect way of importing the library functions:

// -----------------
import * from "getFinanceData";
getPrice(ev)

// OR

import getPrice as gp from "getFinanceData";
getPrice(ev)

import getRevenue, getProfit from getFinanceData
import { getRevenue, getProfit } from getFinanceData

from getFinanceData import *

Delete library

You cannot delete a library that is referenced or imported in a transformation.

To delete a library, go to Collect > Transformations > Libraries and click the Delete button next to the library that you want to delete.

Default RudderStack libraries

By default, RudderStack provides four predefined libraries which you can directly import into your transformations. Refer to the GitHub codebase for the code and implementation-specific details for these libraries.

Currently, RudderStack libraries are available only for JavaScript. Python support (applicable for Growth/Enterprise customers) is coming soon.

Use the following structure to import the Rudderstack libraries:

@rs/<libraryname>/v1

A sample import statement is shown below:

import { JSEncrypt } from "@rs/encrypt/v1";

The following table lists the default RudderStack libraries and their usage:

Questions? Contact us by email or on Slack