Connect to Adobe Commerce Data in as an External Source in Dremio

The CData JDBC Driver for Adobe Commerce implements JDBC Standards and allows various applications, including Dremio, to work with live Adobe Commerce data. Dremio is a data lakehouse platform designed to empower self-service, interactive analytics on the data lake. With the CData JDBC Driver, you can include live Adobe Commerce data as a part of your enterprise data lake. This article describes how to connect to Adobe Commerce data from Dremio as an External Source.

The CData JDBC Driver enables high-speed access to live Adobe Commerce data in Dremio. Once you install the driver, authenticate with Adobe Commerce and gain immediate access to Adobe Commerce data within your data lake. By surfacing Adobe Commerce data using native data types and handling complex filters, aggregations, & other operations automatically, the CData JDBC Driver grants seamless access to Adobe Commerce data.

Build the ARP Connector

To use the CData JDBC Driver in Dremio, you need to build an Advanced Relation Pushdown (ARP) Connector. You can view the source code for the Connector on GitHub or download the ZIP file (GitHub.com) directly. Once you copy or extract the files, run the following command from the root directory of the connector (the directory containing the pom.xml file) to build the connector.

mvn clean install

Once the JAR file for the connector is built (in the target directory), you are ready to copy the ARP connector and JDBC Driver to your Dremio instance.

Installing the Connector and JDBC Driver

Install the ARP Connector to %DREMIO_HOME%/jars/ and the JDBC Driver for Adobe Commerce to %DREMIO_HOME%/jars/3rdparty. You can use commands similar to the following:

ARP Connector

docker cp PATH\TO\dremio-adobe commerce-plugin-20.0.0.jar dremio_image_name:/opt/dremio/jars/

JDBC Driver for Adobe Commerce

docker cp PATH\TO\cdata.jdbc.adobe commerce.jar dremio_image_name:/opt/dremio/jars/3rdparty/

Connecting to Adobe Commerce

Adobe Commerce will now appear as an External Source option in Dremio. The ARP Connector built uses a JDBC URL to connect to Adobe Commerce data. The JDBC Driver has a built-in connection string designer that you can use (see below).

Built-in Connection String Designer

For assistance in constructing the JDBC URL, use the connection string designer built into the Adobe Commerce JDBC Driver. Double-click the JAR file or execute the jar file from the command line.

java -jar cdata.jdbc.adobe commerce.jar

Fill in the connection properties and copy the connection string to the clipboard.

Adobe Commerce uses the OAuth 1 authentication standard. To connect to the Adobe Commerce REST API, you will need to obtain values for the OAuthClientId, OAuthClientSecret, and CallbackURL connection properties by registering an app with your Adobe Commerce system. See the "Getting Started" section in the help documentation for a guide to obtaining the OAuth values and connecting.

You will also need to provide the URL to your Adobe Commerce system. The URL depends on whether you are using the Adobe Commerce REST API as a customer or administrator.

• Customer: To use Adobe Commerce as a customer, make sure you have created a customer account in the Adobe Commerce homepage. To do so, click Account -> Register. You can then set the URL connection property to the endpoint of your Adobe Commerce system.

• Administrator: To access Adobe Commerce as an administrator, set CustomAdminPath instead. This value can be obtained in the Advanced settings in the Admin menu, which can be accessed by selecting System -> Configuration -> Advanced -> Admin -> Admin Base URL.

  If the Use Custom Admin Path setting on this page is set to YES, the value is inside the Custom Admin Path text box; otherwise, set the CustomAdminPath connection property to the default value, which is "admin".

NOTE: To use the JDBC Driver in Dremio, you will need a license (full or trial) and a Runtime Key (RTK). For more information on obtaining this license (or a trial), contact our sales team.

Add the Runtime Key (RTK) to the JDBC URL. You will end up with a JDBC URL similar to the following:

jdbc:adobe commerce:RTK=5246...;OAuthClientId=MyConsumerKey;OAuthClientSecret=MyConsumerSecret;CallbackURL=http://127.0.0.1:33333;Url=https://myAdobe Commercehost.com;InitiateOAuth=GETANDREFRESH

Access Adobe Commerce as an External Source

To add Adobe Commerce as an External Source, click to add a new source and select Adobe Commerce. Copy the JDBC URL and paste it into the New Adobe Commerce Source wizard.

Save the connection and you are ready to query live Adobe Commerce data in Dremio, easily incorporating Adobe Commerce data into your data lake.

More Information & Free Trial

Using the CData JDBC Driver for Adobe Commerce in Dremio, you can incorporate live Adobe Commerce data into your data lake. Check out our CData JDBC Driver for Adobe Commerce page for more information about connecting to Adobe Commerce. Download a free, 30 day trial of the CData JDBC Driver for Adobe Commerce and get started today.