Create FTP-Connected Visualizations in Klipfolio

Klipfolio is an online dashboard platform designed to create real-time business dashboards, whether for your team or clients. When combined with CData Connect AI, you gain immediate cloud-to-cloud access to FTP data to create visualizations, reports, and more. This article provides step-by-step instructions on connecting to FTP within Connect AI and creating visualizations using FTP data in Klipfolio.

CData Connect AI offers a direct cloud-to-cloud interface for FTP, enabling you to construct reports from real-time FTP data data within Klipfolio—without the need for data replication to a database natively supported by Klipfolio. While building visualizations, Klipfolio generates SQL queries to fetch data. With optimized data processing capabilities out of the box, CData Connect AI efficiently directs all supported SQL operations (such as filters, JOINs, etc.) directly to FTP, harnessing server-side processing to swiftly retrieve the requested FTP data data.

Configure FTP Connectivity for Klipfolio

Connectivity to FTP from Klipfolio is made possible through CData Connect AI. To work with FTP data from Klipfolio, we start by creating and configuring a FTP connection.

1. Log into Connect AI, click Sources, and then click Add Connection

2. Select "FTP" from the Add Connection panel

3. Enter the necessary authentication properties to connect to FTP.

   To connect to FTP or SFTP servers, specify at least RemoteHost and FileProtocol. Specify the port with RemotePort.

   Set User and Password to perform Basic authentication. Set SSHAuthMode to use SSH authentication. See the Getting Started section of the data provider help documentation for more information on authenticating via SSH.

   Set SSLMode and SSLServerCert to secure connections with SSL.

   The data provider lists the tables based on the available folders in your FTP server. Set the following connection properties to control the relational view of the file system:

   • RemotePath: Set this to the current working directory.
   • TableDepth: Set this to control the depth of folders to list as views.
   • FileRetrievalDepth: Set this to retrieve and list files recursively from the root table.

   Stored Procedures are available to download files, upload files, and send protocol commands. See the Data Model chapter of the FTP data provider documentation for more information.

   
4. Click Save & Test
5. Navigate to the Permissions tab in the Add FTP Connection page and update the User-based permissions.

Add a Personal Access Token

When connecting to Connect AI through the REST API, the OData API, or the Virtual SQL Server, a Personal Access Token (PAT) is used to authenticate the connection to Connect AI. It is best practice to create a separate PAT for each service to maintain granularity of access.

1. Click on the Gear icon () at the top right of the Connect AI app to open the settings page.
2. On the Settings page, go to the Access Tokens section and click Create PAT.
3. Give the PAT a name and click Create.
4. The personal access token is only visible at creation, so be sure to copy it and store it securely for future use.

With the connection configured and a PAT generated, you are ready to connect to FTP data from Klipfolio.

Connect to FTP from Klipfolio

The steps below outline connecting to CData Connect AI from Klipfolio to create a new FTP data source.

1. Open Klipfolio
2. Click in Data Sources to add a new data source
3. Search for and select MSSQL as the Service
4. Click "Create a custom MSSQL data source"
5. Configure the data source by setting the MSSQL connection properties:
   • Host: tds.cdata.com
   • Port: 14333
   • Database: your database (e.g., FTP1)
   • Driver: MS SQL
   • Username: a Connect AI user (e.g. [email protected])
   • Password: the above user's PAT
   • SQL Query: any query to retrieve data (e.g. SELECT * FROM MyDirectory )
   • Select the checkbox to "Include column headers"
   • Select the checkbox to "Use SSL/TLS"
   
6. Click "Get data" to preview the FTP data before building a data model.

Build a Data Model

After retrieving the data, click the checkbox to "Model your data" and click "Continue." In the new window, configure your data model.

1. Confirm that the model includes all columns you wish to work with
2. Name your model
3. (optional) Set the Description
4. Set "Header in row" to 1
5. Click the toggle to "Exclude data before row" and set the value to 2
6. Click "Save and Exit"

Create a Metric

With the data modeled, we are ready to create a Metric (or visualization) of the data to be used in the Klipfolio platform for dashboards, reporting, and more.

1. Click "Create metrics"
2. Select a Data source
3. Select a Metric value and default aggregation
4. Select Segmentation(s)
5. Select a Date & time
6. Select a Data shape
7. Configure the Display settings
8. Click Save
9. Navigate to your Metric and further configure the visualization

SQL Access to FTP Data from Cloud Applications

Now you have a Metric built from live FTP data. You can add it to a new dashboard, share, and more. Easily create more data sources and new visualizations, produce reports, and more — all without replicating FTP data.

To get SQL data access to hundreds of SaaS, Big Data, and NoSQL sources directly from your cloud applications, try CData Connect AI.