Sync data from Google Sheets to your warehouse destination via RudderStack.
Google Sheets is a popular spreadsheet program that lets you create and manage your spreadsheets.
This document guides you in setting up Google Sheets as a source in RudderStack. Once configured, RudderStack automatically ingests your Google Sheets data and routes it to your specified data warehouse destination.
Go to Sources > New source > Cloud Extract and select Google Sheets from the list of sources.
Assign a name to your source and click Continue.
Next, configure the following dashboard settings:
Authentication: From the dropdown, select the authentication mechanism for RudderStack to connect to the Google Sheets API.
Authenticate via Google (OAuth): To authenticate via OAuth, click the Sign in with Google button, select your Google account, and give RudderStack the required permissions.
Service Account Key Authentication: Enter your service account JSON credentials in the Service Account Information field.
Spreadsheet Link: From the dropdown, select the spreadsheet from which RudderStack should ingest and sync the data.
For the Authenticate via Google (OAuth) authentication option, RudderStack will automatically populate all spreadsheets associated with the account.
For the Service Account Key Authentication option, you need to first provide access to the required spreadsheet. Only the spreadsheets for which you provide the access will be listed in the dropdown. For more information, refer to the FAQ section below.
The following settings specify how RudderStack sends the data ingested from Google Sheets to the connected warehouse destination:
Table prefix: RudderStack uses this prefix to create a table in your data warehouse and loads all your Google Sheets data into it.
Schedule Settings: RudderStack gives you three options to ingest the data from Google Sheets:
Basic: Runs the syncs at the specified time interval.
CRON: Runs the syncs based on the user-defined CRON expression.
Manual: You are required to run the syncs manually.
For more information on the schedule types, refer to the Common Settings guide.
Selecting the data to import
You can specify the Google Sheets data you want to sync by selecting the required sheet. You can also sync data from multiple sheets within the spreadsheet:
RudderStack considers the first row of each sheet as the header. Empty sheets or sheets with an empty header will not be reflected in the Select data to import window.
You can also define the sync mode for each data resource you want to send to the destination. Click Edit resources configuration and specify the destination sync mode for the selected resource(s):
Overwrite: RudderStack adds new rows in the warehouse destination and deletes the rows from previous syncs. This is the default sync mode.
Append and deduplicate: RudderStack adds new rows and updates modified records in the warehouse destination in each sync.
The following destinations support the above sync modes:
Google Sheets is now configured as a source. RudderStack will start ingesting data from Google Sheets as per your specified schedule and frequency.
You can further connect this source to your data warehouse by clicking the Add Destination button:
Use the Use Existing Destination option if you have an already-configured data warehouse destination in RudderStack. To configure a data warehouse destination from scratch, select the Create New Destination button.
How RudderStack syncs data to the warehouse
If you select multiple sheets in the Select data to import window, RudderStack creates multiple tables (corresponding to each sheet) in the warehouse.
In the above example, RudderStack creates a table corresponding to each sheet (List of Tracking Plans, Import Template, and so on) in the warehouse.
While syncing data to the warehouse, RudderStack creates columns only for the headers (first rows in the sheet) which also have data present in the second row (mandatory) and beyond (optional).
The mere presence of a header does not create a column in the destination.
How do I provide service account access to a Google sheet?
If you’re using a service account to authenticate RudderStack to sync your Google Sheets data, you must also give the required access to the service account to access the required spreadsheet. Follow these steps to provide access to the required spreadsheet:
cookies, the cookies that are categorized as necessary are stored on your browser as they are as
for the working of basic functionalities of the website. We also use third-party cookies that
analyze and understand how you use this website. These cookies will be stored in your browser
consent. You also have the option to opt-out of these cookies. But opting out of some of these
have an effect on your browsing experience.
Necessary cookies are absolutely essential for the website to function properly. This
category only includes cookies that ensures basic functionalities and security
features of the website. These cookies do not store any personal information.
learn more about cookies and why we use them, visit our cookie
policy. We'll assume you're ok with this, but you can opt-out if you wish Cookie Settings.