We are proud to share our inclusion in the 2024 Gartner Magic Quadrant for Data Integration Tools. We believe this recognition reflects the differentiated business outcomes CData delivers to our customers.
Get the Report →Access Live Databricks Data in SAS JMP via ODBC
You can use the CData ODBC Driver to integrate Databricks data into the statistical analysis tools available in SAS JMP. This article shows how to use Databricks data in the Graph Builder and Query Builder.
You can use the CData ODBC Driver for Databricks to integrate live data into your statistical analysis with SAS JMP. The driver proxies your queries directly to the Databricks API, ensuring that your analysis reflects any changes to the data. The CData ODBC Driver supports the standard SQL used by JMP in the background as you design reports.
The Databricks API supports bidirectional access. This article shows how to access Databricks data into a report and create data visualization. It also shows how to use SQL to query and manipulate Databricks data from the JMP Query Builder.
About Databricks Data Integration
Accessing and integrating live data from Databricks has never been easier with CData. Customers rely on CData connectivity to:
- Access all versions of Databricks from Runtime Versions 9.1 - 13.X to both the Pro and Classic Databricks SQL versions.
- Leave Databricks in their preferred environment thanks to compatibility with any hosting solution.
- Secure authenticate in a variety of ways, including personal access token, Azure Service Principal, and Azure AD.
- Upload data to Databricks using Databricks File System, Azure Blog Storage, and AWS S3 Storage.
While many customers are using CData's solutions to migrate data from different systems into their Databricks data lakehouse, several customers use our live connectivity solutions to federate connectivity between their databases and Databricks. These customers are using SQL Server Linked Servers or Polybase to get live access to Databricks from within their existing RDBMs.
Read more about common Databricks use-cases and how CData's solutions help solve data problems in our blog: What is Databricks Used For? 6 Use Cases.
Getting Started
Access Databricks Data as an ODBC Data Source
If you have not already, first specify connection properties in an ODBC DSN (data source name). This is the last step of the driver installation. You can use the Microsoft ODBC Data Source Administrator to create and configure ODBC DSNs.
To connect to a Databricks cluster, set the properties as described below.
Note: The needed values can be found in your Databricks instance by navigating to Clusters, and selecting the desired cluster, and selecting the JDBC/ODBC tab under Advanced Options.
- Server: Set to the Server Hostname of your Databricks cluster.
- HTTPPath: Set to the HTTP Path of your Databricks cluster.
- Token: Set to your personal access token (this value can be obtained by navigating to the User Settings page of your Databricks instance and selecting the Access Tokens tab).
When you configure the DSN, you may also want to set the Max Rows connection property. This will limit the number of rows returned, which is especially helpful for improving performance when designing reports and visualizations.
Import Databricks Data with the Query Builder
After you have created the Databricks DSN, you can use SQL to invoke the capabilities of the Databricks API. Follow the steps below to execute some supported queries in the Query Builder:
- In SAS JMP, click File -> Database -> Query Builder. The Select Database Connection dialog is displayed.
- Click New Connection.
- On the Machine Data Source tab, select the ODBC DSN you configured and then click Next.
- The Select Tables for Query dialog is displayed and in the Available Tables section, select a table and click Primary. After choosing the primary table, click Build Query to open the Query Builder.
- As you drag Available Columns to the Included Columns tab, the underlying SQL query is updated and you can view the generated SQL Query in the SQL tab.
- Click Run Query to display the data.
- To refresh the results with the current data, right-click Update from Database and click Run Script.
Manipulate Databricks Data
You can execute data manipulation queries from JSL scripts such as the one below. To execute a script, click New Script in the toolbar. To connect, specify the DSN. You can then use the standard SQL syntax:
Open Database( "DSN=CData Databricks Source;",
"INSERT INTO Customers
(Country)
VALUES ('US');");
Visualize Databricks Data
After importing, you can use the Graph Builder to create graphs visually. To open the Graph Builder, click the Graph Builder button in the toolbar.
- Drag a dimension column onto the x axis. For example, City.
- Drag a measure column onto the y axis. For example, CompanyName.
- Select a chart type. For example, a bar chart.