Ready to get started?

Learn more about CData Cloud Hub or sign up for a free trial:

Learn More

Connect to HPCC Systems Data as a Federated Tables in MySQL

Use the CData Cloud Hub to set up federated tables for HPCC Systems data in MySQL .

You can use the CData Cloud Hub to set up federated tables in MySQL for HPCC Systems data. The Cloud Hub provides a MySQL interface for HPCC Systems: After configuring a virtual MySQL database for HPCC Systems, you can create a server and tables using the FEDERATED Storage Engine in MySQL. You can then work with HPCC Systems data just as you would local MySQL tables.

The CData Cloud Hub provides a pure MySQL, cloud-to-cloud interface for HPCC Systems, allowing you to easily query live HPCC Systems data alongside existing MySQL data — all without replicating the data. Using optimized data processing out of the box, the CData Cloud Hub pushes all supported SQL operations (filters, JOINs, etc) directly to HPCC Systems, leveraging server-side processing to quickly return HPCC Systems data.

Create a Virtual MySQL Database for HPCC Systems Data

CData Cloud Hub uses a straightforward, point-and-click interface to connect to data sources and generate APIs.

  1. Login to Cloud Hub and click Databases.
  2. Select "HPCC Systems" from Available Data Sources.
  3. Enter the necessary authentication properties to connect to HPCC Systems.

    To connect, set the following connection properties: Set URL to the machine name or IP address of the server and the port the server is running on, for example, https://server:port. The User and Password are required to authenticate to the HPCC Systems cluster specified in the URL. Note that LDAP authentication is not currently supported by our ODBC driver.

    Set Version to the WsSQL Web server version. Note that if you have not already done so, you will need to install the WsSQL service on the HPCC Systems server. The WsSQL Web service is used to interact with the underlying HPCC Systems platform.

    Set Cluster to the target cluster.

  4. Click Test Database.
  5. Click Privileges -> Add and add the new user (or an existing user) with the appropriate permissions.

With the virtual database created, you are ready to connect to HPCC Systems data from any MySQL client.

Create a FEDERATED Server and Tables for HPCC Systems Data

After you have configured and started the service, create a FEDERATED server to simplify the process of creating FEDERATED tables:

Create a FEDERATED Server

The following statement will create a FEDERATED server based on the Cloud Hub. Note that the username and password of the FEDERATED server must match a user account you defined on the Cloud Hub.

CREATE SERVER fedHPCC
FOREIGN DATA WRAPPER mysql
OPTIONS (USER 'cloud_hub_user', PASSWORD 'cloud_hub_passwd', HOST 'myinstance.cdatacloud.net', PORT 3306, DATABASE 'hpccdb');

Create a FEDERATED Table

To create a FEDERATED table using our newly created server, use the CONNECTION keyword and pass the name of the FEDERATED server and the remote table (hpcc::test::orders). Refer to the following template for the statement to create a FEDERATED table:

CREATE TABLE fed_hpcc::test::orders (
  ...,
  customername  TYPE(LEN),
  price  TYPE(LEN),
  ...,
)
ENGINE=FEDERATED
DEFAULT CHARSET=utf8
CONNECTION='fedHPCC/hpcc::test::orders';

NOTE: The table schema for the FEDERATED table must match the remote table schema exactly. You can always connect directly to the Cloud Hub using any MySQL client and run SHOW COLUMNS FROM hpcc::test::orders to get the table schema.

Execute Queries

You can now execute queries to the HPCC Systems FEDERATED tables from any tool that can connect to MySQL, which is particularly useful if you need to JOIN data from a local table with data from HPCC Systems. Refer to the following example:

SELECT 
  fed_hpcc::test::orders.customername, 
  local_table.custom_field 
FROM 
  local_table 
JOIN 
  fed_hpcc::test::orders 
ON 
  local_table.foreign_customername = fed_hpcc::test::orders.customername;