Connect to Scrapfly Data from a Connection Pool in Jetty

Jerod Johnson
Jerod Johnson
Director, Technology Evangelism
The Scrapfly JDBC Driver supports connection pooling: This article shows how to connect faster to Scrapfly data from Web apps in Jetty.

The CData JDBC driver for Scrapfly is easy to integrate with Java Web applications. This article shows how to efficiently connect to Scrapfly data in Jetty by configuring the driver for connection pooling. You will configure a JNDI resource for Scrapfly in Jetty.

Configure the JDBC Driver for Salesforce as a JNDI Data Source

Follow the steps below to connect to Salesforce from Jetty.

  1. Enable the JNDI module for your Jetty base. The following command enables JNDI from the command-line:

    java -jar ../start.jar --add-to-startd=jndi
    
  2. Add the CData and license file, located in the lib subfolder of the installation directory, into the lib subfolder of the context path.
  3. Declare the resource and its scope. Enter the required connection properties in the resource declaration. This example declares the Scrapfly data source at the level of the Web app, in WEB-INF\jetty-env.xml.

    
    <Configure id='scrapflydemo' class="org.eclipse.jetty.webapp.WebAppContext">
        <New id="scrapflydemo" class="org.eclipse.jetty.plus.jndi.Resource">
        <Arg><Ref refid="scrapflydemo"/></Arg>
        <Arg>jdbc/scrapflydb</Arg>
        <Arg>
          <New class="cdata.jdbc.api.APIDriver">
            <Set name="url">jdbc:api:</Set>
            <Set name="Profile">C:\profiles\Scrapfly.apip</Set>
            <Set name="AuthScheme">APIKey</Set>
            <Set name="ProfileSettings">'APIKey</Set>
          </New>
        </Arg>
      </New>
    </Configure>
    

    The Scrapfly API uses API Key authentication. The API key is passed as the key query parameter on every request.

    Using API Key Authentication

    Your Scrapfly API key is required to create a connection. To obtain your API key:

    1. Log into your Scrapfly account at scrapfly.io.
    2. Navigate to Dashboard and select API Keys.
    3. Copy your API key (begins with scp-live- for production or scp-test- for the test environment).

    After obtaining your API key, set the following connection properties:

    • AuthScheme: Set this to APIKey.
    • APIKey: Set this to your Scrapfly API key.

    Example connection string:

    Profile=C:\profiles\Scrapfly.apip;AuthScheme=APIKey;ProfileSettings='APIKey=your_api_key';
    
  4. Configure the resource in the Web.xml:

    
      jdbc/scrapflydb
      javax.sql.DataSource
      Container
    
    
  5. You can then access Scrapfly with a lookup to java:comp/env/jdbc/scrapflydb:

    InitialContext ctx = new InitialContext();
    DataSource myscrapfly = (DataSource)ctx.lookup("java:comp/env/jdbc/scrapflydb");
    

More Jetty Integration

The steps above show how to configure the driver in a simple connection pooling scenario. For more use cases and information, see the Working with Jetty JNDI chapter in the Jetty documentation.

Ready to get started?

Connect to live data from Scrapfly with the API Driver

Connect to Scrapfly