Apache Hudi

Hudi is a rich platform to build streaming data lakes with incremental data pipelines on a self-managing database layer, while being optimized for lake engines and regular batch processing. Hudi brings transactions, record-level updates/deletes and change streams to data lakes!

Web site

Github repository

Tech tags:

• Data lake
• Support CDC streaming
• Support nested schema
• Support evolving schema
• Support transactions
• Support Upsert
• Support data compaction

Related shared contents:

• Query an Apache Hudi dataset in an Amazon S3 data lake with Amazon Athena part 1: Read-optimized queries
  poc
  2021-07-16

In productions with: