Delta Lake

Delta lake is an open-source project that enables building a Lakehouse architecture on top of existing storage systems such as S3, ADLS, GCS, and HDFS.

Web site

Github repository

Tech tags:

• Data lake
• Support transactions
• Support Upsert
• Support evolving schema
• Data versioning
• Unified model for batch and streaming
• Audit history
• Support data compaction

Related shared contents:

• The next evolution of Delta - Catalog-Managed Tables
  tech1
  2026-02-02

  The article discusses the introduction of catalog-managed tables in Delta Lake 4.1.0, which shift the management of table access and metadata from the filesystem to a catalog-centric model. This change aims to simplify table discovery, enhance governance, and improve performance by allowing clients to reference tables by name rather than by path. The article also highlights the challenges faced with filesystem-managed tables and how catalog-managed tables address these issues, paving the way for a more interoperable and efficient data ecosystem.

In productions with: