Apache Paimon

Apache Paimon is an open-source streaming data lake storage framework designed for both batch and real-time processing. It is optimized for high-throughput, low-latency workloads and serves as a lakehouse solution that integrates well with big data engines like Apache Flink, Apache Spark, and Trino.

Web site

Github repository

Tech tags:

• Support evolving schema
• Support CDC streaming
• Support Flink library

Related shared contents:

• How Yelp modernized its data infrastructure with a streaming lakehouse on AWS
  project
  2025-11-13

  The article discusses Yelp's transformation of its data infrastructure through the adoption of a streaming lakehouse architecture on AWS. This modernization aimed to address challenges related to data processing latency, operational complexity, and compliance with regulations like GDPR. By migrating from self-managed Apache Kafka to Amazon MSK and implementing Apache Paimon for storage, Yelp achieved significant improvements, reducing analytics data latencies from 18 hours to minutes and cutting storage costs by over 80%. The article outlines the architectural shifts and technologies involved in this transformation.

In productions with: