Amazon Kinesis Data Analytics
Amazon Kinesis Data Analytics is the easiest way to analyze streaming data, gain actionable insights, and respond to your business and customer needs in real time. Amazon Kinesis Data Analytics reduces the complexity of building, managing, and integrating streaming applications with other Amazon Web Services services.
You can build sophisticated applications using Apache Flink. Apache Flink is an open source framework and engine for processing data streams. Your applications can transform and analyze data in real time, and integrate with other Amazon Web Services services in as little as one line of code. You can also use an interactive SQL editor to easily query streaming data and build streaming applications. Simply point to a streaming data source like Amazon Kinesis Data Streams and use standard SQL to analyze your data in real-time.
Amazon Kinesis Data Analytics takes care of everything required to run your real-time applications continuously and scales automatically to match the volume and throughput of your incoming data. With Amazon Kinesis Data Analytics, you only pay for the resources your streaming applications consume. There is no minimum fee or setup cost.
Benefits
Powerful real-time processing
Amazon Kinesis Data Analytics provides built-in functions to filter, aggregate, and transform streaming data for advanced analytics. It processes streaming data with sub-second latencies, enabling you to analyze and respond to incoming data and streaming events in real time.
No servers to manage
Amazon Kinesis Data Analytics is serverless; there are no servers to manage. It runs your streaming applications without requiring you to provision or manage any infrastructure. Amazon Kinesis Data Analytics automatically scales the infrastructure up and down as required to run your applications with low latency.
Pay only for what you use
With Amazon Kinesis Data Analytics, you pay only for the processing resources that your streaming applications use. There are no minimum fees or upfront commitments.
Easy to use
Amazon Kinesis Data Analytics enables you to easily and quickly build queries and sophisticated streaming applications in three simple steps: setup your streaming data sources, write your queries or streaming applications, and setup your destination for processed data.
Build sophisticated streaming analytics applications with Apache Flink
Amazon Kinesis Data Analytics includes open source libraries and runtimes based on Apache Flink that enable you to build an application in hours instead of months using your favorite IDE. The extensible libraries include different APIs that are specialized for different use cases including stateful stream processing, streaming ETL, and real-time analytics. You can use the libraries to integrate with Amazon Web Services services like Amazon Managed Streaming for Apache Kafka (Amazon MSK), Amazon Kinesis Data Streams, Amazon Kinesis Data Firehose, Amazon OpenSearch Service (successor to Amazon Elasticsearch Service), Amazon S3, Amazon DynamoDB, and more.
Quickly get started with streaming data processing with Amazon Kinesis Data Analytics Studio
With Amazon Kinesis Data Analytics Studio, you can interactively query data streams and rapidly develop stream processing applications using an interactive development environment powered by Apache Zeppelin notebooks. Apache Flink powers the stream processing.
Use your favorite language
Amazon Kinesis Data Analytics supports building applications in SQL, Java, Scala, and Python. You can extend the open source libraries and include custom libraries from the language of your choice. Using Amazon Kinesis Data Analytics Studio, you can build applications interactively in SQL, Scala, and Python using Apache Zeppelin notebooks.
Use cases
Amazon Kinesis Data Analytics is ideal for solving a wide range of streaming data use cases, including:
Streaming ETL for Internet-of-Things (IoT) with Apache Flink Applications
You can develop applications with Apache Flink libraries and use Amazon Kinesis Data Analytics to transform, aggregate, and filter streaming data from IoT devices such as consumer appliances, embedded sensors, and TV set-top boxes. You can then use the data to send real-time alerts when a sensor exceeds certain operating thresholds.
Real-time log analytics with SQL
You can stream billions of small messages to Amazon Kinesis Data Analytics and calculate key metrics, which you can then use to refresh content performance dashboards in real time and improve content performance.
