Design BIRT Reports on ScrapingBee Data

Jerod Johnson
Jerod Johnson
Director, Technology Evangelism
Provide current ScrapingBee data to your embedded analytics.

The CData JDBC Driver for ScrapingBee integrates connectivity to ScrapingBee APIs into your data-driven Java applications. You can use the CData JDBC Driver for ScrapingBee with the BIRT (Business Intelligence Reporting Tools) platform to create BIRT reports that reflect changes to your data in real time.

  1. If you have not already done so, install the BIRT Framework plugin and the Database Development plugin for Eclipse.
  2. Click File -> New -> Report. The Report Design perspective is opened.
  3. In the Data Explorer, right-click Data Sources and click New Data Source.
  4. Select the Create from a Data Source Type in the Following List option and select JDBC Data Source.
  5. Click Manage Drivers and add the driver JAR, located in the lib subfolder of the installation folder.
  6. In the Database URL box, enter the JDBC URL containing the connection string.

    Using API Key Authentication

    ScrapingBee uses API key authentication. To obtain an API key:

    1. Sign in to your ScrapingBee account at https://app.scrapingbee.com
    2. Navigate to the Dashboard and locate your API key in the top section.
    3. Copy the API key for use in the connection string.

    After obtaining your API key, set the following connection properties:

    • AuthScheme: Set this to APIKey.
    Set the following in the ProfileSettings connection property:
    • APIKey: Set this to your ScrapingBee API key.

    Example Connection String

    Profile=C:\profiles\ScrapingBee.apip;AuthScheme=APIKey;ProfileSettings="APIKey=your_api_key";
    

    Connecting to ScrapingBee

    Once the authentication is configured, you can connect to ScrapingBee and query data from any of the available tables. All tables require at least one input parameter (such as a search query or product ID) to retrieve data.

    Built-in Connection String Designer

    For assistance in constructing the JDBC URL, use the connection string designer built into the ScrapingBee JDBC Driver. Either double-click the JAR file or execute the jar file from the command-line.

    java -jar cdata.jdbc.api.jar
    

    Fill in the connection properties and copy the connection string to the clipboard.

    When you configure the JDBC URL, you may also want to set the Max Rows connection property. This will limit the number of rows returned, which is especially helpful for improving performance when designing reports and visualizations.

    A typical JDBC URL is below:

    jdbc:api:Profile=C:\profiles\ScrapingBee.apip;AuthScheme=APIKey;ProfileSettings="APIKey=your_api_key";
    
  7. Right-click the Data Sets folder and select the JDBC data source for ScrapingBee.
  8. In the resulting dialog, build the SELECT query to be used to retrieve the data for the report. This article uses the following query:
    SELECT ,  FROM GoogleSearchResults WHERE SearchQuery = 'cdata drivers'
    
  9. In the Palette, drag a Chart onto the editor. The chart wizard is displayed.
  10. After selecting the chart type, drag columns onto the chart fields on the Select Data tab.
  11. Click Run -> View Report -> In Web Viewer to view the report.

Your BIRT reports can now pick up any updates to ScrapingBee data.

To publish the report to your application server, add the driver JAR to the BIRT Viewer's classpath. For more information, see the CData KB for guides to deploying the JDBC Driver on Java application servers.

Ready to get started?

Connect to live data from ScrapingBee with the API Driver

Connect to ScrapingBee