Posted On: Feb 27, 2024
Today, Amazon is renaming Amazon Kinesis Data Firehose to Amazon Data Firehose. Amazon Data Firehose provides an easy way to reliably capture, transform, and optimally deliver data streams into Amazon S3 based data lakes, Amazon Redshift, Amazon OpenSearch Service, Splunk, and other 3rd party destinations for analytics and archival. The name change is effective in the Amazon Web Services Management Console, documentations, and service web pages. There are no other changes, including to service endpoints, APIs, the Amazon Command Line Interface (Amazon CLI), the Amazon Identity and Access Management (IAM) access policies, Amazon CloudWatch metrics, or the Amazon Billing console dashboard. Your existing applications will continue to work as they did previously.
With Amazon Data Firehose, you can reduce the complexity of creating and maintaining streaming data delivery pipeline. Amazon Data Firehose will manage the provisioning and scaling of resources on your behalf. Amazon Data Firehose integrates with Amazon Kinesis Data Streams (KDS), Amazon Managed Streaming for Kafka (MSK), and over 20 other Amazon Web Services sources, to ingest the streaming data. Additionally, you have an option to ingest data directly from your own data source using the Direct PUT API. You can also transform your data streams into formats like Parquet and ORC, and dynamically partition data to write to the Amazon S3 destination bucket with different S3 prefixes using metadata attributes. You only pay for the amount of data you process through the service without minimum fee or setup cost.
To learn more, explore the Amazon Data Firehose Developer Guide. Amazon Data Firehose is available in all Amazon Web Services regions, including the Amazon Web Services China (Beijing) Region, operated by Sinnet and the Amazon Web Services China (Ningxia) Region, operated by NWCD.