We are proud to share our inclusion in the 2024 Gartner Magic Quadrant for Data Integration Tools. We believe this recognition reflects the differentiated business outcomes CData delivers to our customers.
Get the Report →A PostgreSQL Interface for Snowflake Data
Use the Remoting features of the Snowflake ODBC Driver to create a PostgreSQL entry-point for data access.
There are a vast number of PostgreSQL clients available on the Internet. From standard Drivers to BI and Analytics tools, PostgreSQL is a popular interface for data access. Using the remoting features of our JDBC Drivers, you can now create PostgreSQL entry-points that you can connect to from any standard client.
To access Snowflake data as a PostgreSQL database, use the Remoting feature of the CData JDBC Driver for Snowflake and the MySQL foreign data wrapper (FDW) from EnterpriseDB. In this article, we install the FDW and query Snowflake data from PostgreSQL Server.
About Snowflake Data Integration
CData simplifies access and integration of live Snowflake data. Our customers leverage CData connectivity to:
- Reads and write Snowflake data quickly and efficiently.
- Dynamically obtain metadata for the specified Warehouse, Database, and Schema.
- Authenticate in a variety of ways, including OAuth, OKTA, Azure AD, Azure Managed Service Identity, PingFederate, private key, and more.
Many CData users use CData solutions to access Snowflake from their preferred tools and applications, and replicate data from their disparate systems into Snowflake for comprehensive warehousing and analytics.
For more information on integrating Snowflake with CData solutions, refer to our blog: https://www.cdata.com/blog/snowflake-integrations.
Getting Started
Configure the Connection to Snowflake
Follow the steps below to configure the driver's MySQL daemon to use the credentials and other connection properties needed to connect to Snowflake. The MySQL daemon exposes Snowflake data as a MySQL database named CDataSnowflake. Add connection properties to the databases section of the configuration file for the daemon. The configuration file for the daemon is located in the lib subfolder of the installation directory for the driver.
Below is a typical connection string:
[databases]
snowflake = "User=Admin;Password=test123;Server=localhost;Database=Northwind;Warehouse=TestWarehouse;Account=Tester1;"
Additionally, create a user in the users section.
You can find all of the configuration options for the MySQL daemon in the help documentation.
Start the Remoting Service
Follow the steps below to enable the MySQL Remoting feature of the CData JDBC Driver for Snowflake.
The driver creates a default configuration suitable for testing: Simply start the service to connect to Snowflake data.
- Start the MySQL Remoting Service with the following command:
java -jar cdata.jdbc.snowflake.jar -f cdata.jdbc.snowflake.remoting.ini
Build and Install the MySQL Foreign Data Wrapper
The Foreign Data Wrapper can be installed as an extension to PostgreSQL, without recompiling PostgreSQL.
If pgxn is available for your operating system, you can install with the following:
pgxn install mysql_fdw USE_PGXS=1
Otherwise, follow the steps below to build it yourself:
- Install the MySQL C client library and obtain the source for the EnterpriseDB FDW for MySQL; from GitHub, for example.
- Build the FDW. Add the pg_config and mysql_config executables to your PATH:
env PATH=/usr/local/pgsql/bin:/usr/local/mysql/bin:$PATH make USE_PGXS=1
-
Install the FDW:
make USE_PGXS=1 install
To complete the installation, you will need to load the libmysqlclient library into the environment; for example by adding it to the path.
Query Snowflake Data as a PostgreSQL Database
After you have installed the extension, follow the steps below to start executing queries to Snowflake data:
- Log into your database.
-
Load the extension for the database:
postgres=#CREATE EXTENSION mysql_fdw;
-
Create a server object for Snowflake data:
postgres=# CREATE SERVER Snowflake FOREIGN DATA WRAPPER mysql_fdw OPTIONS (host '127.0.0.1', port '3309');
-
Create a user mapping for the username and password of a user known to the MySQL daemon.
postgres=# CREATE USER MAPPING for postgres SERVER Snowflake OPTIONS (username 'admin', password 'test');
-
Create the local schema:
postgres=# CREATE SCHEMA Snowflake_db;
-
Import all the tables in the Snowflake database you defined in the daemon configuration file:
postgres=# IMPORT FOREIGN SCHEMA "Snowflake" FROM SERVER Snowflake INTO Snowflake_db;
You can now execute read/write commands to Snowflake:
postgres=# SELECT * FROM Snowflake_db."products";