Discover how a bimodal integration strategy can address the major data management challenges facing your organization today.
Get the Report →How to integrate Metabase with Databricks Data
Use CData Connect Cloud to connect to live Databricks data and create an interactive dashboard in Metabase from Databricks data.
Metabase is an open source data visualization tool that allows users to create interactive dashboards. When paired with CData Connect Cloud, users can easily create visualizations and dashboards linked to live Databricks data. This article describes how to connect to Databricks and build a simple visualization using Databricks data.
CData Connect provides a pure cloud-to-cloud interface for Databricks, allowing you to easily integrate with live Databricks data in Metabase — without replicating the data. Connect looks exactly like a SQL Server database to Metabase and uses optimized data processing out of the box to push all supported SQL operations (filters, JOINs, etc) directly to Databricks, leveraging server-side processing to quickly return Databricks data.
Configure Databricks Connectivity for Metabase
Connectivity to Databricks from Metabase is made possible through CData Connect Cloud. To work with Databricks data from Metabase, we start by creating and configuring a Databricks connection.
- Log into Connect Cloud, click Connections and click Add Connection
- Select "Databricks" from the Add Connection panel
-
Enter the necessary authentication properties to connect to Databricks.
To connect to a Databricks cluster, set the properties as described below.
Note: The needed values can be found in your Databricks instance by navigating to Clusters, and selecting the desired cluster, and selecting the JDBC/ODBC tab under Advanced Options.
- Server: Set to the Server Hostname of your Databricks cluster.
- HTTPPath: Set to the HTTP Path of your Databricks cluster.
- Token: Set to your personal access token (this value can be obtained by navigating to the User Settings page of your Databricks instance and selecting the Access Tokens tab).
- Click Create & Test
- Navigate to the Permissions tab in the Add Databricks Connection page and update the User-based permissions.
Add a Personal Access Token
If you are connecting from a service, application, platform, or framework that does not support OAuth authentication, you can create a Personal Access Token (PAT) to use for authentication. Best practices would dictate that you create a separate PAT for each service, to maintain granularity of access.
- Click on your username at the top right of the Connect Cloud app and click User Profile.
- On the User Profile page, scroll down to the Personal Access Tokens section and click Create PAT.
- Give your PAT a name and click Create.
- The personal access token is only visible at creation, so be sure to copy it and store it securely for future use.
With the connection configured, you are ready to connect to Databricks data from Metabase.
Connect to CData Connect from Metabase
After creating the virtual database, navigate to your Metabase instance. Use the SQL Server interface to connect to Connect Cloud.
- Navigate to the administration screen (Settings -> Admin) and click "Add Database" from the "Databases" tab
- Configure the connection to Connect Cloud and click "Save"
- Database type: Select "SQL Server"
- Name: Name the connection (e.g. "Databricks (Connect Cloud)")
- Host: tds.cdata.com
- Port: 14333
- Database name: The name of the connection you just created (e.g. Databricks1)
- Username: A Connect Cloud username (e.g. [email protected])
- Password: The PAT for the above Connect Cloud user
- Click to Use a secure connection (SSL)
Execute Databricks Data with Metabase
Once you configure the connection to Connect Cloud, you can query Databricks and build visualizations.
- Use the "Write SQL" tool to retrieve the Databricks data
- Write a SQL query based on the Databricks connection in CData Connect Cloud, e.g.
SELECT City, CompanyName FROM Customers WHERE Country = 'US'
- Navigate to the "Visualization" screen, choose a visualization, and configure the visualization
More Information & Free Trial
At this point, you have built a simple visualization from Databricks data in Metabase. You can continue to work with live Databricks data in Metabase just like you would any SQL Server database. For more information on creating a live connection to Databricks (and more than 100 other data sources), visit the Connect Cloud page. Sign up for a free trial and start working with live Databricks data in Metabase today.