Posted On: Jun 19, 2023
Amazon Athena has updated its data source connectors with new optimizations that can improve performance and reduce cost when querying data that does not reside in Amazon S3. Available today, the updated connectors use dynamic filtering and new predicate push down optimizations to perform more operations in the underlying data source, rather than in Athena, which can reduce query processing time and reduce data scanned.
Athena uses connectors to run federated queries on 30 different data sources. Connectors process data where it’s stored, so there’s no need for ETL scripts to extract data from underlying data sources before it can be used for interactive analysis, business intelligence reporting, and other use cases. Today’s launch expands the set of query operations that are pushed down to the data source for processing.