Announcing Amazon S3 Metadata – Accelerate data discovery with near real-time object metadata
Amazon S3 Metadata is a fast and easy way to instantly discover and understand your S3 data with automated, easily queried metadata that updates in near real time. This helps you to curate, identify, and use your S3 data for business analytics, real-time inference applications, and more. S3 Metadata supports object metadata, which includes system-defined details like size and source of the object, and custom metadata, which lets you annotate your objects with tags like product SKU, transaction ID, or content rating. S3 Metadata automatically populates metadata for both new and existing objects, providing you with a comprehensive, queryable view of your data.
S3 Metadata creates and maintains two Apache Iceberg tables in an Amazon Web Services managed table bucket in your account. A journal table records changes made to your data in near real time, helping you identify new data uploaded to your bucket, track recently deleted objects, monitor lifecycle transitions, and more. A live inventory table provides and maintains an up-to-date view of all objects in your bucket. Both tables are stored in an Amazon Web Services managed table bucket in your account and can be queried using standard SQL through Amazon Web Services analytics services such as Amazon Athena or Amazon EMR, and open source tooling.
Amazon S3 Metadata is now available in the Amazon Web Services China (Beijing) Region, operated by Sinnet, and the Amazon Web Services China (Ningxia) Region, operated by NWCD. For pricing details, visit the S3 pricing page. To learn more, visit the product page and documentation.