Build Pipelines with Live SAP Ariba Source Data in Google Cloud Data Fusion (via CData Connect Cloud)

Google Cloud Data Fusion simplifies building and managing data pipelines by offering a visual interface to connect, transform, and move data across various sources and destinations, streamlining data integration processes. When combined with CData Connect Cloud, it provides access to SAP Ariba Source data for building and managing ELT/ETL data pipelines. This article explains how to use CData Connect Cloud to create a live connection to SAP Ariba Source and how to connect and access live SAP Ariba Source data from the Cloud Data Fusion platform.

Configure SAP Ariba Source Connectivity for Cloud Data Fusion

Connectivity to SAP Ariba Source from Cloud Data Fusion is made possible through CData Connect Cloud. To work with SAP Ariba Source data from Cloud Data Fusion, we start by creating and configuring a SAP Ariba Source connection.

1. Log into Connect Cloud, click Connections and click Add Connection
2. Select "SAP Ariba Source" from the Add Connection panel
3. Enter the necessary authentication properties to connect to SAP Ariba Source.

   In order to connect with SAP Ariba Source, set the following:

   • API: Specify which API you would like the provider to retrieve SAP Ariba data from. Select the Supplier, Sourcing Project Management, or Contract API based on your business role (possible values are SupplierDataAPIWithPaginationV4, SourcingProjectManagementAPIV2, or ContractAPIV1).
   • DataCenter: The data center where your account's data is hosted.
   • Realm: The name of the site you want to access.
   • Environment: Indicate whether you are connecting to a test or production environment (possible values are TEST or PRODUCTION).

   If you are connecting to the Supplier Data API or the Contract API, additionally set the following:

   • User: Id of the user on whose behalf API calls are invoked.
   • PasswordAdapter: The password associated with the authenticating User.

   If you're connecting to the Supplier API, set ProjectId to the Id of the sourcing project you want to retrieve data from.

   Authenticating with OAuth

   After setting connection properties, you need to configure OAuth connectivity to authenticate.

   • Set AuthScheme to OAuthClient.
   • Register an application with the service to obtain the APIKey, OAuthClientId and OAuthClientSecret.

     For more information on creating an OAuth application, refer to the Help documentation.

   Automatic OAuth

   After setting the following, you are ready to connect:

   APIKey: The Application key in your app settings. OAuthClientId: The OAuth Client Id in your app settings. OAuthClientSecret: The OAuth Secret in your app settings.

   When you connect, the provider automatically completes the OAuth process:

   1. The provider obtains an access token from SAP Ariba and uses it to request data.
   2. The provider refreshes the access token automatically when it expires.
   3. The OAuth values are saved in memory relative to the location specified in OAuthSettingsLocation.
   
4. Click Create & Test
5. Navigate to the Permissions tab in the Add SAP Ariba Source Connection page and update the User-based permissions.

Add a Personal Access Token

If you are connecting from a service, application, platform, or framework that does not support OAuth authentication, you can create a Personal Access Token (PAT) to use for authentication. Best practices would dictate that you create a separate PAT for each service, to maintain granularity of access.

1. Click on your username at the top right of the Connect Cloud app and click User Profile.
2. On the User Profile page, scroll down to the Personal Access Tokens section and click Create PAT.
3. Give your PAT a name and click Create.

4. The personal access token is only visible at creation, so be sure to copy it and store it securely for future use.

With the connection configured, you are ready to connect to SAP Ariba Source data from Cloud Data Fusion.

Connecting to SAP Ariba Source from Cloud Data Fusion

Follow these steps to establish a connection from Cloud Data Fusion to SAP Ariba Source through the CData Connect Cloud JDBC driver:

1. Download and install the CData Connect Cloud JDBC driver:
   1. Open the Client Tools page of CData Connect Cloud.
   2. Search for JDBC or Cloud Data Fusion.
   3. Click on Download and select your operating system (Mac/Windows/Linux).
   4. Once the download is complete, run the setup file.
   5. When the installation is complete, the JAR file can be found in the installation directory (inside the lib folder).
2. Log into Cloud Data Fusion.
3. Click the green "+" button at the top right to add an entity.
4. Under Driver, click Upload.
5. Now, upload the CData Connect Cloud JDBC driver (JAR file).
6. Enter the driver settings:
   • Name: Enter the name of the driver
   • Class name: Enter "cdata.jdbc.connect.ConnectDriver"
   • Version: Enter the driver version
   • Description (optional): Enter a description for the driver
7. Click on Finish.
8. Enter source configuration settings:
   • Label: Helps to identify the connection
   • JDBC driver name: Enter the JDBC driver name to identify the driver configured in Step 6.
   • Connection string: Enter the JDBC connection string and include the following parameters in it: jdbc:connect:AuthScheme=Basic;User=[User];Password=[Password];
   • User: Enter your CData Connect Cloud username, displayed in the top-right corner of the CData Connect Cloud interface. For example, "[email protected]"
   • Password: Enter the PAT you generated on the Settings page.
9. Click Validate in the top right corner.
10. If the connection is successful, you can manage the pipeline by editing it through the UI.
11. Run the pipepline created.

Troubleshooting

Please be aware that there is a known issue in Cloud Data Fusion where "int" types from source data are automatically cast as "long".

Live Access to SAP Ariba Source Data from Cloud Applications

Now you have a direct connection to live SAP Ariba Source data from from Google Cloud Data Fusion. You can create more connections to ensure a smooth movement of data across various sources and destinations, thereby streamlining data integration processes - all without replicating SAP Ariba Source data.

To get real-time data access to 100+ SaaS, Big Data, and NoSQL sources (including SAP Ariba Source) directly from your cloud applications, explore the CData Connect Cloud.