Access Live Apache Airflow Data in SAS JMP via ODBC

You can use the CData API Driver for ODBC to integrate live data into your statistical analysis with SAS JMP. The driver proxies your queries directly to the Apache Airflow API, ensuring that your analysis reflects any changes to the data. The CData ODBC Driver supports the standard SQL used by JMP in the background as you design reports.

This article shows how to access Apache Airflow data into a report and create data visualization. It also shows how to use SQL to query Apache Airflow data from the JMP Query Builder.

Access Apache Airflow Data as an ODBC Data Source

If you have not already, first specify connection properties in an ODBC DSN (data source name). This is the last step of the driver installation. You can use the Microsoft ODBC Data Source Administrator to create and configure ODBC DSNs.

Start by setting the Profile connection property to the location of the ApacheAirflow Profile on disk (e.g. C:\profiles\ApacheAirflow.apip). Next, set the ProfileSettings connection property to the connection string for ApacheAirflow (see below).

ApacheAirflow API Profile Settings

Apache Airflow 3 uses JWT Bearer tokens for API authentication. You can generate a token from the Airflow web UI under Settings or via the Airflow CLI using airflow users create and the /api/v2/auth/token endpoint. Note that this profile targets Apache Airflow 3.x using the /api/v2 REST API. The legacy /api/v1 endpoint used by Airflow 2.x is not supported.

After setting the following connection properties, you are ready to connect:

• AuthScheme: Set this to APIKey.
• APIKey: Set this to your Apache Airflow JWT Bearer token.
• Server: Set this to the base URL of your Airflow instance (e.g. http://localhost:8080).

When you configure the DSN, you may also want to set the Max Rows connection property. This will limit the number of rows returned, which is especially helpful for improving performance when designing reports and visualizations.

Import Apache Airflow Data with the Query Builder

After you have created the Apache Airflow DSN, you can use SQL to invoke the capabilities of the Apache Airflow API. Follow the steps below to execute some supported queries in the Query Builder:

1. In SAS JMP, click File -> Database -> Query Builder. The Select Database Connection dialog is displayed.
2. Click New Connection.
3. On the Machine Data Source tab, select the ODBC DSN you configured and then click Next.
4. The Select Tables for Query dialog is displayed and in the Available Tables section, select a table and click Primary. After choosing the primary table, click Build Query to open the Query Builder.
5. As you drag Available Columns to the Included Columns tab, the underlying SQL query is updated and you can view the generated SQL Query in the SQL tab.
6. Click Run Query to display the data.
7. To refresh the results with the current data, right-click Update from Database and click Run Script.

Visualize Apache Airflow Data

After importing, you can use the Graph Builder to create graphs visually. To open the Graph Builder, click the Graph Builder button in the toolbar.

1. Drag a dimension column onto the x axis. For example, DagRunId.
2. Drag a measure column onto the y axis. For example, State.
3. Select a chart type. For example, a bar chart.