How Meta discovers data flows via lineage at scale

Original URL: https://engineering.fb.com/2025/01/22/security/how-meta-discovers-data-flows-via-lineage-at-scale/

Added Date: January 28, 2025

Memo: Explained in the three systems (API, data warehouse, AI inference), how to efficiently collect and validate the Lineage metadata.