Analytics engineering is the data transformation work that happens between loading data into your warehouse and analyzing it. DBT allows anyone comfortable with SQL to own that workflow.
Tech tags:
Related shared contents:
-
project2026-02-01
The article discusses Spotify's innovative multi-agent architecture designed to enhance its advertising platform. By addressing the fragmented decision-making processes across various advertising channels, the architecture aims to unify workflows and optimize campaign management through specialized AI agents. This approach allows for more efficient budget allocation, audience targeting, and overall campaign performance, leveraging historical data and machine learning. The article highlights the importance of a programmable decision layer and the challenges faced in implementing this system.
-
project2025-12-29
The article discusses Vinted's journey in standardizing large-scale decentralized data pipelines as they migrated their data infrastructure to the cloud. Initially, teams operated independently, but as dependencies grew, coordination became challenging. To address this, they developed a DAG generator that abstracts pipeline creation and standardizes dependency interactions, allowing teams to focus on data models rather than orchestration details. This approach improved visibility and reduced operational complexity across decentralized teams.
-
tech22024-12-12
This article discusses the challenges and solutions for building end-to-end data lineage in enterprise data analytics, particularly for one-time and complex queries. It highlights the use of Amazon Athena, Amazon Redshift, Amazon Neptune, and dbt to create a unified data modeling language across different platforms. The authors explain how to automate the data lineage generation process using AWS services like Lambda and Step Functions, ensuring accuracy and scalability. The article provides insights into the architecture and implementation details necessary for effective data lineage tracking.
-
product2025-06-24
i don't know "OpenLineage standard" before, I guess Datahub should enable to support it as well.
-
project2024-11-12
-
product2024-12-12
Build a process to built the complete data lineage information by merging the partial lineage generated by dbt automatically.
-
project2024-11-06
Why we load the S3 data into the Redshift again? it already queryable via Redshift Spectrum? I guess it's for the performance? Transform the S3 raw data, build the data models and write back into S3?
-
vision2024-09-18
Fully adapt the SDLC practises for analytic world ...
-
vision2022-02-15
This article is for talk about the idea behind fal dbt, extend the dbt capability on airflow platform. It also talk about a lot of other popular tools on Airflow.
-