Managing state and dependencies in data workflows

Level: product

Articles Addressing This Problem (1):

Dynamic Data Pipelines with Airflow Datasets and Pub/Sub

Good "dataset" feature since 2.4.0, released on September 19, 2022.

product Added: Nov 18, 2024