Apache Spark JDBC Driver

Easily connect live Spark data with Java-based BI, ETL, Reporting, AI/ML & Custom Apps.

The Spark JDBC Driver enables users to connect with live Spark data, directly from any applications that support JDBC connectivity. Rapidly create and deploy powerful Java applications that integrate with Apache Spark.

Spark

Spark JDBC Connectivity Features

Maps SQL to Spark SQL, enabling direct standard SQL-92 access to Apache Spark
Fully compatible with the DataBricks Enterprise Platform
Connect to live Apache Spark SQL data, for real-time data access with the Apache Spark SQL JDBC Driver
Full support for data aggregation and complex JOINs in SQL queries
Secure connectivity through modern cryptography, including TLS 1.2, SHA-256, ECC, etc.
Seamless integration with leading BI, reporting, and ETL tools and with custom applications via the Spark Connector.

Target Service, API

The driver connects to Apache Spark via Spark SQL. Big data processing.

Schema, Data Model

Models Spark tables and DataFrames. Supports various data sources.

Key Objects

Databases, Tables, and Views. Spark SQL catalog access.

Operations

Spark SQL queries. Read/write to various formats. No direct Spark job control.

Authentication

Varies by deployment. Kerberos for secure clusters.

Start a 30-day Free Trial Today

Spark JDBC Driver Download

JDBC Access to Apache Spark SQL

Full-featured and consistent SQL access to any supported data source through JDBC

Certified Compatibility*

Our drivers undergo extensive testing and are certified to be compatible with leading analytics and reporting applications like SAP Crystal Reports, Pentaho, Business Objects, Crystal Reports and many more.
Metadata Discovery

Full support for JDBC DatabaseMetaData provides extensive schema discovery capabilities. Explore tables, columns, keys, and other data constructs based on user identity.
Developer Friendly

Design-time support for all major Java IDEs, including Eclipse, IntelliJ, and NetBeans.
JDBC Remoting

Our exclusive remoting feature allows hosting the JDBC connection on a server to enable connections from various clients on any platform (Java, .NET, C++, PHP, Python), using any standards-based technology (ODBC, JDBC, etc.). JDBC Remoting is enabled using the popular MySQL wire protocol server.
Replication and Caching

Our replication and caching commands make it easy to copy data to local and cloud data stores such as Oracle, SQL Server, Google Cloud SQL, etc. The replication commands include many features that allow for intelligent incremental updates to cached data.

String, Date, Numeric SQL Functions

The driver includes a library of over 50 functions that can manipulate column values into the desired result. Popular examples include Regex, JSON, and XML processing functions.
Collaborative Query Processing

Our drivers enhance the data source's capabilities by additional client-side processing, when needed, to enable analytic summaries of data such as SUM, AVG, MAX, MIN, etc.
Easily Customizable and Configurable

The data model exposed by our JDBC Drivers can easily be customized to add or remove tables/columns, change data types, etc. without requiring a new build. These customizations are supported at runtime using human-readable schema files that are easy to edit.
Secure Connectivity

Includes standard Enterprise-class security features such as TLS/ SSL data encryption for all client-server communications.

See what you can do with Spark JDBC Driver

Data Integration & ETL

Integrate Spark into your systems and data warehouses through popular Java-based ETL/EAI tools. Supports both self-hosted environments and cloud service deployment.

and more

BI, Reporting & Data Virtualization

Connect to Spark from any JDBC-compatible BI, reporting, and data virtualization platform. Provides seamless integration using SQL as the standard query interface across all tools.

and more

Custom Java Applications

Use the Spark JDBC Driver to rapidly deliver Java-based applications that connect with Spark. Universal SQL-based interactivity simplifies integration and speeds time to market.

and more

Connect to Spark — empower every team

Management & Data Consumer Team

CData JDBC Drivers for Spark will act as if it is a native connector for you ETL, BI, Data Virtualization tool.
Organizations can connect to the new services to capture full view of business, or migrate to modern data technology while maintaining the connection to existing sytems.
Speed up your AI initiative with CData. Connect your data with the AI / ML platform of your choice.

IT Team

Need to integrate your internal systems with Spark? CData JDBC Drivers let you do it easily. Java based applications can easily connect to Spark with SQL/JDBC — any ETL, EAI (Enterprise Application Integration), ESB (Enterpriese Service Bus) can connect to Spark.

ISVs & Cloud Service Vendors for embedded JDBC

Embed CData JDBC Drivers for Spark to your product and differentiate with your connectivity
Standard SQL access. Stop researching on different authentication, data model and query methods.
Utilize your resource to build your product, CData takes care of your connectivity

Learn more

Frequently Asked Spark JDBC Driver Questions

Learn more about Spark JDBC drivers for data and analytics integration

Can Spark be used with Java?

Yes, Spark can be used with Java . CData provides a JDBC type 4/5 driver for Spark that allows Java applications to connect to Spark using standard JDBC APIs. This driver enables you to execute SQL queries, manage connections, and process data stored in Spark from Java, or any Java-based application that supports JDBC.

Does Spark support JDBC?

Not natively. However, CData offers a JDBC driver for Spark that allows you to connect to Spark data from any Java-based application that supports JDBC, just like you would access a traditional database. This can be useful for tasks like:

Accessing Spark from applications: Connect to Spark data in popular tools and applications including Informatica, Talend, Apache Spark, Apache NiFi, and many others.
Real-time data: You can work with live Spark data within these applications, enabling tasks like reporting and analysis.
Connecting systems: Build data integrations between Spark and other systems.

The Spark JDBC driver is a pure Java type 4/5 driver with comprehensive ANSI SQL-92 support. This means that virtually any application that can connect to data via JDBC, can use the CData JDBC driver for real-time integration. Download a fully functional free trial of the Spark JDBC driver today to get started.

Is there a JDBC driver for Spark?

Yes, the CData JDBC driver for Spark provides universal JDBC data connectivity for Spark. The Spark JDBC driver offers a simple SQL-based layer of abstraction that simplifies real-time data access for users and applications, enabling them to communicate with Spark using a standardized set of functions. Virtually any application on any platform can use the CData JDBC driver for real-time integration.

How do I connect to Spark via JDBC?

Connectivity to Spark via JDBC is easy. First, download and install the Spark JDBC driver.

Once the installation is complete, navigate to the JDBC driver documentation page. Here, you'll find a wealth of information about the installed driver. The step-by-step instructions for creating a DSN and using it to connect to Spark via JDBC are just the beginning. The documentation also provides extensive configuration details for using the Spark JDBC driver with all your favorite applications and development tools, ensuring you have all the support you need.

Where can I download a JDBC driver for Spark?

All of the CData JDBC drivers, including the Spark JDBC driver are available for download online. To get started, download a fully functional free trial of the Spark JDBC driver today.

How do I install the JDBC driver for Spark?

To install the Spark driver, simply download one of the Spark JDBC driver installers available online. The installers are comprehensive setup utilities that will install all the components required to use the Spark JDBC driver on your system.