Kinesis Firehose
Delivery stream from sources to S3 / Redshift / OpenSearch.
Configuration
Section titled “Configuration”| Setting | Type | Required | Default |
|---|---|---|---|
| Delivery stream | Text | Yes | — |
| Destination Options: Extended S3 | Choice | — | extended_s3 |
| Buffering interval (s) | Number | — | 300 |
| Buffering size (MB) | Number | — | 5 |
| Compression format Options: Uncompressed, GZIP, ZIP, Snappy, Hadoop Snappy | Choice | — | UNCOMPRESSED |
| S3 bucket ARN | Text | — | — |
| Object prefix | Text | — | — |
| Error prefix | Text | — | — |
| IAM role ARN | Text | — | — |
| KMS key ARN (encryption) | Text | — | — |
| Transform processor Options: None, Lambda, Record deaggregation, Append delimiter | Choice | — | NONE |
| Lambda ARN (transform) | Text | — | — |
| Tags | Key–value | — | — |
Connections
Section titled “Connections”| Socket | Direction | Accepts | Terraform arg |
|---|---|---|---|
| Source | Input | any | — |
| Delivery IAM role | Input | aws.iam-role | extended_s3_configuration.role_arn |
| KMS key | Input | aws.kms-key | extended_s3_configuration.kms_key_arn |
| Transform Lambda | Input | aws.lambda | extended_s3_configuration.processing_configuration.processors.parameters.parameter_value |
| Destination bucket | Output | aws.s3 | extended_s3_configuration.bucket_arn |