Apache Iceberg

Apache Iceberg is an open table format for huge analytic datasets. Iceberg adds tables to compute engines including Spark, Trino, PrestoDB, Flink and Hive using a high-performance table format that works just like a SQL table.

Web site

Github repository

Tech tags:

• Data lake
• Support evolving schema
• Data versioning

Related shared contents:

• How Amazon Ads uses Iceberg optimizations to accelerate their Spark workload on Amazon S3
  project
  2024-11-22

  Improving the data processing efficiency by implementing Apache Iceberg's base-2 file layout for S3.
• Build Write-Audit-Publish pattern with Apache Iceberg branching and AWS Glue Data Quality
  product
  2024-12-09

  Without Iceberg, there are lot of overhead works to implement WAP pattern.
• Implement historical record lookup and Slowly Changing Dimensions Type-2 using Apache Iceberg
  spike
  2024-12-09

In productions with: