Using the CData ODBC Driver for ScrapingBee in PyCharm

The CData ODBC Drivers can be used in any environment that supports loading an ODBC Driver. In this tutorial we will explore using the CData ODBC Driver for ScrapingBee from within PyCharm. Included are steps for adding the CData ODBC Driver as a data source, as well as basic PyCharm code to query the data source and display results.

To begin, this tutorial will assume that you have already installed the CData ODBC Driver for ScrapingBee as well as PyCharm.

Add Pyodbc to the Project

Follow the steps below to add the pyodbc module to your project.

1. Click File -> Settings to open the project settings window.
2. Click Project Interpreter from the Project: YourProjectName menu.
3. To add pyodbc, click the + button and enter pyodbc.
4. Click Install Package to install pyodbc.

Connect to ScrapingBee

You can now connect with an ODBC connection string or a DSN. See the Getting Started section in the CData driver documentation for a guide to creating a DSN on your OS.

Using API Key Authentication

ScrapingBee uses API key authentication. To obtain an API key:

1. Sign in to your ScrapingBee account at https://app.scrapingbee.com
2. Navigate to the Dashboard and locate your API key in the top section.
3. Copy the API key for use in the connection string.

After obtaining your API key, set the following connection properties:

• AuthScheme: Set this to APIKey.

• APIKey: Set this to your ScrapingBee API key.

Example Connection String

Profile=C:\profiles\ScrapingBee.apip;AuthScheme=APIKey;ProfileSettings="APIKey=your_api_key";

Connecting to ScrapingBee

Once the authentication is configured, you can connect to ScrapingBee and query data from any of the available tables. All tables require at least one input parameter (such as a search query or product ID) to retrieve data.

Below is the syntax for a DSN:

[CData API Source]
Driver = CData ODBC Driver for ScrapingBee
Description = My Description
Profile = C:\profiles\ScrapingBee.apip
AuthScheme = APIKey
ProfileSettings = "APIKey = your_api_key"

Execute SQL to ScrapingBee

Instantiate a Cursor and use the execute method of the Cursor class to execute any SQL statement.

import pyodbc

cnxn = pyodbc.connect('DRIVER={CData ODBC Driver for API};Profile = C:\profiles\ScrapingBee.apip;AuthScheme = APIKey;ProfileSettings = "APIKey = your_api_key";')
cursor = cnxn.cursor()
cursor.execute("SELECT ,  FROM GoogleSearchResults WHERE SearchQuery = 'cdata drivers'")
rows = cursor.fetchall()
for row in rows:
  print(row., row.)

After connecting to ScrapingBee in PyCharm using the CData ODBC Driver, you will be able to build Python apps with access to ScrapingBee data as if it were a standard database. If you have any questions, comments, or feedback regarding this tutorial, please contact us at [email protected].