Automated Continuous Zuora Replication to Snowflake

Always-on applications rely on automatic failover capabilities and real-time data access. CData Sync integrates live Zuora data into your Snowflake instance, allowing you to consolidate all of your data into a single location for archiving, reporting, analytics, machine learning, artificial intelligence and more.

Configure Snowflake as a Replication Destination

Using CData Sync, you can replicate Zuora data to Snowflake. To add a replication destination, navigate to the Connections tab.

1. Click Add Connection.
2. Select the Destinations tab and locate the Snowflake connector.
3. Click the Configure Connection icon at the end of that row to open the New Connection page. If the Configure Connection icon is not available, click the Download Connector icon to install the Snowflake connector. For more information about installing new connectors, see Connections in the Help documentation.
4. To connect to Snowflake, set the following connection properties:
   • Connection Name: Enter a connection name of your choice for the Snowflake connection.
   • Warehouse: Enter the name of your Snowflake warehouse.
   • URL: Enter the URL for your Snowflake database. CData Sync supports both Microsoft Azure and Amazon Web Services (AWS) instances:
     • AWS: https://MyAccount.Region.snowflakecomputing.com
     • Azure: https://MyAccount.Region.azure.snowflakecomputing.com
   • URL: Enter the URL of the Snowflake database instance, for example: https://myaccount.snowflakecomputing.com
   • Database: The name of the Snowflake database
   • Auth Scheme: Select the authentication scheme. The default auth scheme is Password. The auth schemes available for Snowflake are Password, OKTA, PrivateKey, AzureAD, OAuth, PingFederate, and External Browser.
   • User: Enter the username that you use to authenticate to Snowflake.
   • Password: Enter the password that you use to authenticate to Snowflake.
   • Schema: The schema of the Snowflake database.

5. Once connected, click Create & Test to create, test and save the connection.

You are now connected to Snowflake and can use it as both a source and a destination.

NOTE: You can use the Label feature to add a label for a source or a destination.

In this article, we will demonstrate how to load Zuora data into Snowflake and utilize it as a destination.

Configure the Zuora Connection

You can configure a connection to Zuora from the Connections tab. To add a connection to your Zuora account, navigate to the Connections tab.

1. Click Add Connection.
2. Select a source (Zuora).
3. Configure the connection properties.
   
   

   Zuora uses the OAuth standard to authenticate users. See the online Help documentation for a full OAuth authentication guide.

   Configuring Tenant property

   In order to create a valid connection with the provider you need to choose one of the Tenant values (USProduction by default) which matches your account configuration. The following is a list with the available options:

   • USProduction: Requests sent to https://rest.zuora.com.
   • USAPISandbox: Requests sent to https://rest.apisandbox.zuora.com"
   • USPerformanceTest: Requests sent to https://rest.pt1.zuora.com"
   • EUProduction: Requests sent to https://rest.eu.zuora.com"
   • EUSandbox: Requests sent to https://rest.sandbox.eu.zuora.com"

   Selecting a Zuora Service

   Two Zuora services are available: Data Query and AQuA API. By default ZuoraService is set to AQuADataExport.

   DataQuery

   The Data Query feature enables you to export data from your Zuora tenant by performing asynchronous, read-only SQL queries. We recommend to use this service for quick lightweight SQL queries.

   Limitations
   • The maximum number of input records per table after filters have been applied: 1,000,000
   • The maximum number of output records: 100,000
   • The maximum number of simultaneous queries submitted for execution per tenant: 5
   • The maximum number of queued queries submitted for execution after reaching the limitation of simultaneous queries per tenant: 10
   • The maximum processing time for each query in hours: 1
   • The maximum size of memory allocated to each query in GB: 2
   • The maximum number of indices when using Index Join, in other words, the maximum number of records being returned by the left table based on the unique value used in the WHERE clause when using Index Join: 20,000

   AQuADataExport

   AQuA API export is designed to export all the records for all the objects ( tables ). AQuA query jobs have the following limitations:

   Limitations
   • If a query in an AQuA job is executed longer than 8 hours, this job will be killed automatically.
   • The killed AQuA job can be retried three times before returned as failed.
   
4. Click Connect to Zuora to ensure that the connection is configured properly.
5. Click Save & Test to save the changes.

Configure Replication Queries

CData Sync enables you to control replication with a point-and-click interface and with SQL queries. For each replication you wish to configure, navigate to the Jobs tab and click Add Job. Select the Source and Destination for your replication.

Replicate Entire Tables

To replicate an entire table, navigate to the Task tab in the Job, click Add Tasks, choose the table(s) from the list of Zuora tables you wish to replicate into Snowflake, and click Add Tasks again.

Customize Your Replication

Schedule Your Replication

Select the Overview tab in the Job, and click Configure under Schedule. You can schedule a job to run automatically by configuring it to run at specified intervals, ranging from once every 10 minutes to once every month.

Once you have configured the replication job, click Save Changes. You can configure any number of jobs to manage the replication of your Zuora data to Snowflake.

Run the Replication Job

Once all the required configurations are made for the job, select the Zuora table you wish to replicate and click Run. After the replication completes successfully, a notification appears, showing the time taken to run the job and the number of rows replicated.

Free Trial & More Information

Now that you have seen how to replicate Zuora data into Snowflake, visit our CData Sync page to explore more about CData Sync and download a free 30-day trial. Start consolidating your enterprise data today!

As always, our world-class Support Team is ready to answer any questions you may have.