Ready to get started?

Learn more about CData Cloud Hub or sign up for a free trial:

Learn More

Connect to Amazon S3 Data as a Federated Tables in MySQL

Use the CData Cloud Hub to set up federated tables for Amazon S3 data in MySQL .

You can use the CData Cloud Hub to set up federated tables in MySQL for Amazon S3 data. The Cloud Hub provides a MySQL interface for Amazon S3: After configuring a virtual MySQL database for Amazon S3, you can create a server and tables using the FEDERATED Storage Engine in MySQL. You can then work with Amazon S3 data just as you would local MySQL tables.

The CData Cloud Hub provides a pure MySQL, cloud-to-cloud interface for Amazon S3, allowing you to easily query live Amazon S3 data alongside existing MySQL data — all without replicating the data. Using optimized data processing out of the box, the CData Cloud Hub pushes all supported SQL operations (filters, JOINs, etc) directly to Amazon S3, leveraging server-side processing to quickly return Amazon S3 data.

Create a Virtual MySQL Database for Amazon S3 Data

You can use any MySQL client to connect to the CData Cloud Hub and create virtual databases.

  1. Connect to the CData Cloud Hub:
    mysql --host --user admin --password
  2. Once authenticated, create the virtual database for Amazon S3:
    mysql> CREATE DATABASE amazons3db
        -> DRIVER = "AmazonS3",
        -> DBURL = "AccessKey=a123;SecretKey=s123;";

With the virtual database created, you are ready to connect to Amazon S3 data from any MySQL client.

Create a FEDERATED Server and Tables for Amazon S3 Data

After you have configured and started the service, create a FEDERATED server to simplify the process of creating FEDERATED tables:

Create a FEDERATED Server

The following statement will create a FEDERATED server based on the Cloud Hub. Note that the username and password of the FEDERATED server must match a user account you defined on the Cloud Hub.

OPTIONS (USER 'cloud_hub_user', PASSWORD 'cloud_hub_passwd', HOST '', PORT 3306, DATABASE 'amazons3db');

Create a FEDERATED Table

To create a FEDERATED table using our newly created server, use the CONNECTION keyword and pass the name of the FEDERATED server and the remote table (ObjectsACL). Refer to the following template for the statement to create a FEDERATED table:

CREATE TABLE fed_objectsacl (
  name  TYPE(LEN),
  ownerid  TYPE(LEN),

NOTE: The table schema for the FEDERATED table must match the remote table schema exactly. You can always connect directly to the Cloud Hub using any MySQL client and run SHOW COLUMNS FROM ObjectsACL to get the table schema.

Execute Queries

You can now execute queries to the Amazon S3 FEDERATED tables from any tool that can connect to MySQL, which is particularly useful if you need to JOIN data from a local table with data from Amazon S3. Refer to the following example:

  local_table.foreign_name =;