AWS Athena

Amazon Athena is an interactive query service that makes it easy to analyze data in Amazon S3 using standard SQL. It use the PrestoDB as the SQL engine under the hood.

Web site

Tech tags:

• SQL query engine
• Support Hive Metastore

Related shared contents:

• Views pwn Tables as data interfaces
  project
  2024-12-05

  Twitch has leveraged Views in their Data Lake to enhance data agility, minimize downtime, and streamline development workflows. By utilizing Views as interfaces to underlying data tables, they've enabled seamless schema modifications, such as column renames and VARCHAR resizing, without necessitating data reprocessing. This approach has facilitated rapid responses to data quality issues and supported efficient ETL processes, contributing to a scalable and adaptable data infrastructure.
• Building end-to-end data lineage for one-time and complex queries using Amazon Athena, Amazon Redshift, Amazon Neptune and dbt
  product
  2024-12-12

  Build a process to built the complete data lineage information by merging the partial lineage generated by dbt automatically.
• BMW Cloud Data Hub: A reference implementation of the modern data architecture on AWS
  project
  2022-06-22
• How BMW streamlined data access using AWS Lake Formation fine-grained access control
  project
  2024-10-29

  With AWS LakeFormation, creating filter packages and controlling access. A filter package provides a restricted view of a data asset by defining column and row filters on the tables.
• Governing the ML lifecycle at scale, Part 3: Setting up data governance at scale
  product
  2024-11-22

  I think the challenges part still is the adaption of this kind of system, integration and change the workflow is a huge cost for the stakeholder team.

In productions with: