dbt Cloud Transformations with CData Sync

CData Sync supports the execution of ETL and ELT processes flexibly using dbt Cloud, dbt Core, or custom SQL transformations.

Data Build Tool (dbt) Cloud is a cloud-based data transformation platform that lets users define and execute data transformation workflows using SQL to manipulate and aggregate data. dbt Cloud provides a user-friendly interface that allows users to interact with their dbt projects without using dbt Core's command-line interface.

This article provides a step-by-step guide for using dbt Cloud with CData Sync.

Using dbt Cloud with CData Sync

Supported Destinations

Transformations of type dbt Cloud are supported for the following destinations:

• Snowflake
• Amazon Redshift
• Databricks
• PostgreSQL
• Google BigQuery

Connecting CData Sync to dbt Cloud

To connect to dbt Cloud:

1. Open the Advanced tab on the Sync Settings page and navigate to the dbt Cloud Settings section.
2. Click the edit icon for that section to open the dbt Cloud Settings dialog box.

3. Define your Account Id in the dbt Cloud Settings section. Your account Id is available in the URL that you see in your dbt Cloud account settings. To retrieve the Id, sign in to your dbt Cloud account and select Settings (the gear icon) > Account Settings. The account Id follows the /accounts/ path component, as shown in the following example:

   Example: https://cloud.getdbt.com/settings/accounts/1234

   In this example, the account Id is 1234.

4. Select the region for your dbt Cloud API server from the Region list. Values for this setting are as follows: North America, Europe (EMEA), Australia (APAC), and Custom Single Tenant

   If you are not sure about your region, you can find it in the URL for your dbt Cloud API server. For example, if the URL for your dbt Cloud API server is https://cloud.us1.dbt.com, then your API server region is North America. If your API server URL is https://emea.dbt.com, then your API server region is Europe (EMEA).

   Note: Currently, your URL might use cloud.getdbt.com instead of us1.dbt.com for the North America region. However, this URL will be removed in the future.

5. Enter either a dbt Cloud personal access token (PAT) or a service token in the Token field.
   • If you do not have a PAT, you can create it by opening the Account Settings page, then navigate to API Tokens > Personal Tokens in your instance of dbt Cloud. Create a new token, then copy the token and return to Sync to paste it into the Token field in the dbt Cloud Settings dialog box.
   • If you do not have a service token, you can create it by opening the Account Settings page, then navigate to API Tokens > Service Tokens. Create a new token, then copy the token and return to Sync to paste it into the Token field in the dbt Cloud Settings dialog box.
6. Click Test Connection to confirm that you are connected.

Creating a dbt Cloud transformation

To create a dbt Cloud transformation:

1. Open Sync and navigate to the Transformations page. Then, click Add Transformations.
2. Fill out the fields in the Add Transformation dialog box, as follows:
   • Name: Enter a name for your transformation.
   • Type: Select dbt Cloud as the transformation type.
   • dbt Job: Select a dbt job from the drop-down list.
3. Click Add Transformation.

Free Trial & More Information

Now that you have seen how to integrate dbt Cloud with CData Sync, visit our CData Sync page to read more information about CData Sync and download a free trial today! As always, our world-class Support Team is ready to answer any questions you may have.