Amazon S3

The Amazon S3 provider for Data Sync supports read-write operations against an Amazon S3 bucket.

Since S3 stores binary objects you need to connect this provider with a Data Sync provider that supports binary blob or file data.

The following Data Sync providers can be connected to the Amazon S3 provider.

  • FileSystem Provider
  • SharePoint Document Library
  • SQL Server Table with Blob Column configuration.
  • Azure Blob Storage

From V3.0.1290 the Amazon S3 connector supports incremental sync mode.

To connect first enter your Amazon S3 credentials then select the region and finally choose the S3 Bucket Name to connect to.

Connect to Amazon S3


The name of the S3 Bucket to connect to.


Defines a Prefix to be used with S3 bucket queries, the Delimiter is always '/'.


Removes the Prefix from the Path when reading the S3 bucket list.


The AWS region that contains your SimpleDB Domain.


The AWS AccessKey.


The AWS Secret.

You can also use AWS IAM Users/Roles when running from an AWS VM with an IAM role assigned.


Ensures that file paths are returned with forward slashes (/).


Defines two custom metadata fields to contain the file created and modified timestamps in UTC. Data Sync will then use these rather than the Amazon S3 LastModified field which cannot be modified.

  • x-amz-meta-sourcemodifieddate
  • x-amz-meta-sourcecreateddate

Data Schema

Below is the Data Schema that Data Sync returns for the Amazon S3 provider. The actual file data is not part of the schema and is read from Amazon S3 when required during the Synchronisation operation.

Column DataType Description
FullFileName String The full relative path to the item including filename.
Path String The full relative path to the item.
FileName String The filename of the item.
DateCreated DateTime Date Created [x-amz-meta-sourcecreateddate] or LastModified
DateModified DateTime Date Modified [x-amz-meta-sourcemodifieddate] or LastModified
Length Int64 The Length/Size of the file in bytes.
Checksum String The MD5 checksum of the file.

Example Data

Amazon S3 result