Pipe AWS Management Data to CSV in PowerShell

Ready to get started?

Download for a free trial:

Download Now

Learn more:

AWS Management Cmdlets

Access AWS configuration & billing info from Excel

Use standard PowerShell cmdlets to access AWS Management tables.

The CData Cmdlets Module for AWS Management is a standard PowerShell module offering straightforward integration with AWS Management. Below, you will find examples of using our AWSDataManagement Cmdlets with native PowerShell cmdlets.

Creating a Connection to Your AWS Management Data

To authorize AWSDataManagement requests, provide the credentials for an administrator account or for an IAM user with custom permissions:

  1. Set AccessKey to the access key Id.
  2. Set SecretKey to the secret access key.
  3. Set Region to the region where your AWSDataManagement data is hosted.

Note: Though you can connect as the AWS account administrator, it is recommended to use IAM user credentials to access AWS services.

$conn = Connect-AWSDataManagement  -AccessKey "$AccessKey" -Account "$Account" -Region "$Region"

Selecting Data

Follow the steps below to retrieve data from the NorthwingProducts table and pipe the result into to a CSV file:

Select-AWSDataManagement -Connection $conn -Table NorthwingProducts | Select -Property * -ExcludeProperty Connection,Table,Columns | Export-Csv -Path c:\myNorthwingProductsData.csv -NoTypeInformation

You will notice that we piped the results from Select-AWSDataManagement into a Select-Object cmdlet and excluded some properties before piping them into an Export-Csv cmdlet. We do this because the CData Cmdlets append Connection, Table, and Columns information onto each "row" in the result set, and we do not necessarily want that information in our CSV file.

The Connection, Table, and Columns are appended to the results in order to facilitate piping results from one of the CData Cmdlets directly into another one.

Deleting Data

The following line deletes any records that match the criteria:

Select-AWSDataManagement -Connection $conn -Table NorthwingProducts -Where "Id = 1" | Remove-AWSDataManagement

Inserting and Updating Data

The cmdlets make data transformation easy as well as data cleansing. The following example loads data from a CSV file into AWS Management, checking first whether a record already exists and needs to be updated instead of inserted.

Import-Csv -Path C:\MyNorthwingProductsUpdates.csv | %{
  $record = Select-AWSDataManagement -Connection $AWSDataManagement -Table NorthwingProducts -Where ("Id = `'"+$_.Id+"`'")
    Update-AWSDataManagement -Connection $awsdatamanagement -Table NorthwingProducts -Columns ("PartitionKey","Name") -Values ($_.PartitionKey, $_.Name) -Where ("Id = `'"+$_.Id+"`'")
    Add-AWSDataManagement -Connection $awsdatamanagement -Table NorthwingProducts -Columns ("PartitionKey","Name") -Values ($_.PartitionKey, $_.Name)

As always, our goal is to simplify the way you connect to data. With cmdlets users can install a data module, set the connection properties, and start building. Download Cmdlets and start working with your data in PowerShell today!