Apache DataFusion

Apache DataFusion is an open-source query execution framework designed for big data analytics. It is written in Rust and is part of the Apache Arrow ecosystem. DataFusion provides a high-performance, distributed SQL query engine that enables developers to process large datasets using SQL, while benefiting from the efficiency of the Rust programming language and Arrow's in-memory columnar data format.

Web site

Github repository

Tech tags:

• SQL query engine

Related shared contents:

• Parquet pruning in DataFusion
  tech1
  2024-10-24
• Parquet pruning in DataFusion
  tech1
  2024-10-24

In productions with: