The Amazon S3 ADO.NET Data Provider enables user to easily connect to Amazon S3 data from .NET applications. Rapidly create and deploy powerful .NET applications that integrate with Amazon S3 file storage data.
NOTE: To analyze data stored within S3 buckets, please refer to the CSV, JSON, XML, and Parquet ADO.NET Providers. Alternatively, Amazon Athena can analyze data across multiple file-formats via AWS services.
Amazon S3 .NET Connectivity Features
- SQL access to Amazon S3 Buckets and Objects
- Use SQL Stored Procedures to perform actions like uploading, downloading or copying objects
- Connect to delimited files stored in S3 directly with the CSV & XML Drivers
- Connect to live Amazon S3 data, for real-time data access with the Amazon S3 ODBC Driver
- Full support for data aggregation and complex JOINs in SQL queries
- Secure connectivity through modern cryptography, including TLS 1.2, SHA-256, ECC, etc.
- Seamless integration with leading BI, reporting, and ETL tools and with custom applications via the Amazon S3 Connector.
Target Service, API
The driver connects to Amazon S3 object storage service. Provides SQL interface to buckets and objects.
Schema, Data Model
Models S3 buckets and objects as tables. Objects can be parsed as structured data for various file formats.
Key Objects
Buckets, Objects, Object Metadata, and Versions. Access to all S3 storage with appropriate permissions.
Operations
Read and write operations on S3 objects. SQL queries for listing and filtering. Supports multipart uploads.
Authentication
AWS authentication with Access Key/Secret Key or IAM roles. Supports S3 access policies and encryption.
See what you can do with Amazon S3 ADO.NET provider
Use Amazon S3 from SQL Server Analysis Service (SSAS) multi-dimensional cubes. Keep your analytical data modeling and access to any source including cloud and on-premises.
The Amazon S3 ADO.NET Provider allows developers to build applications that connect to Amazon S3 using familiar SQL and Entity Framework. Integrate Amazon S3 to your mission -critical applications or create easy side-by-side applications.
You can connect from ADO.NET compliant low-code development tools:
You can connect Amazon S3 from .NET-based reporting and analytics tools:
Standard ADO.NET Access to AmazonS3
The Amazon S3 ADO.NET Provider offers the most natural way to access Amazon S3 data from any .NET application. Simply use Amazon S3 Data Provider objects to connect and access data just as you would access any traditional database. You will be able to use the Amazon S3 Data Provider through Visual Studio Server Explorer, in code through familiar classes, and in data controls like DataGridView, GridView, DataSet, etc.
The CData ADO.NET Provider for Amazon S3 hides the complexity of accessing data and provides additional powerful security features, smart caching, batching, socket management, and more.
Working with DataAdapters, DataSets, DataTables, etc.
The Amazon S3 Data Provider has the same ADO.NET architecture as the native .NET data providers for SQL Server and OLEDB, including: AmazonS3Connection, AmazonS3Command, AmazonS3DataAdapter, AmazonS3DataReader, AmazonS3DataSource, AmazonS3Parameter, etc. Because of this you can now access Amazon S3 data in an easy, familiar way.
For example:
using (AmazonS3Connection conn = new AmazonS3Connection("...")) {
string select = "SELECT * FROM Buckets";
AmazonS3Command cmd = new AmazonS3Command(select, conn);
AmazonS3DataAdapter adapter = new AmazonS3DataAdapter(cmd);
using (adapter) {
DataTable table = new DataTable();
adapter.Fill(table);
...
}
}
ADO.NET Provider Performance
With traditional approaches to remote access, performance bottlenecks can spell disaster for applications. Regardless if an application is created for internal use, a commercial project, web, or mobile application, slow performance can rapidly lead to project failure. Accessing data from any remote source has the potential to create these problems. Common issues include:
- Network Connections - Slow network connections and latency issues are common in mobile applications.
- Service Delays - Delays due to service interruptions, resulting in server hardware or software updates.
- Large Data - Intentional or unintentional requests for large amounts of data.
- Disconnects - Complete loss of network connectivity.
The CData ADO.NET Provider for Amazon S3 solves these issues by supporting powerful smart caching technology that can greatly improve the performance and dramatically reduce application bottlenecks.
Smart Caching
Smart caching is a configurable option that works by storing queried data into a local database. Enabling smart caching creates a persistent local cache database that contains a replica of data retrieved from the remote source. The cache database is small, lightweight, blazing-fast, and it can be shared by multiple connections as persistent storage.
Caching with our ADO.NET Providers is highly configurable, including options for:
- Auto Cache - Maintain an automatic local cache of data on all requests. The provider will automatically load data into the cache database each time you execute a SELECT query. Each row returned by the query will be inserted or updated as necessary into the corresponding table in the cache database.
- Explicit Cache - Cache only on demand. Developers decide exactly what data gets stored in the cache and when it is updated. Explicit caching provides full control over the cache contents by using explicit execution of CACHE statements.
- No Cache - All requests access only live data and no local cache file is created.
This powerful caching functionality increases application performance and allows applications to disconnect and continue limited functioning without writing code for additional local storage and/or data serialization/deserialization.
More information about ADO.NET Provider caching and best caching practices is available in the included help files.
Visual Studio Integration & Server Explorer
Working with the new Amazon S3 ADO.NET Provider is easy. As a fully-managed .NET Data Provider, the Amazon S3 Data Provider integrates seamlessly with the Visual Studio development environment as well as any .NET application.
As an ADO.NET Data Provider, Amazon S3 ADO.NET Provider can be used to access and explore Amazon S3 data directly from the Visual Studio Server Explorer.
It's easy. As a standard ADO.NET adapter, developers can connect the Server Explorer to Amazon S3 ADO.NET Provider just like connecting to any standard database.
- Add a new Data Connection from the Server Explorer and select the Amazon S3 Data Source
- Configure the basic connection properties to access your Amazon S3 account data.
Explore all of the data available! Amazon S3 ADO.NET Provider makes it easy to access live Amazon S3 data from Visual Studio.
Developer Integration: Databind to Amazon S3
Connecting Web, Desktop, and Mobile .NET applications with Amazon S3 is just like working with SQL Server. It is even possible to integrate Amazon S3 ADO.NET Provider into applications without writing code.
Developers are free to access the Amazon S3 ADO.NET Provider in whatever way they like best. Either visually through the Visual Studio Winforms or Webforms designers, or directly through code.
- Developers can connect the Amazon S3 Data Source directly to form components by configuring the object's smart
tags.
- Add a new Data Connection from the Server Explorer and select the Amazon S3 Data Source. Then, select the
feed, view, or services you would like to connect the object to.
Done! It's just like connecting to SQL Server.
Popular ADO Videos:
