Skip to main content

Overview

Write data to S3-compatible object storage services.

Configuration

sinks:
  my_s3_sink:
    type: s3_sink
    from: my_transform
    endpoint: https://s3.amazonaws.com
    access_key_id: <your-access-key>
    secret_access_key: <your-secret-key>
    region: us-east-1
    bucket: my-bucket
    prefix: my-prefix # Optional

Parameters

type
string
required
Must be s3_sink
from
string
required
The transform or source to read data from
endpoint
string
required
S3-compatible endpoint URL (e.g., https://s3.amazonaws.com, https://t3.storage.dev)
access_key_id
string
required
Access key ID for authentication
secret_access_key
string
required
Secret access key for authentication
region
string
required
AWS region or auto for S3-compatible services
bucket
string
required
Target bucket name
prefix
string
Optional path prefix for objects within the bucket
The S3 sink works with any S3-compatible storage service, including AWS S3, MinIO, Cloudflare R2, and others. Set region: auto for non-AWS services.