Analytics engineering is the data transformation work that happens between loading data into your warehouse and analyzing it. DBT allows anyone comfortable with SQL to own that workflow.
Tech tags:
Related shared contents:
-
tech22024-12-12
This article discusses the challenges and solutions for building end-to-end data lineage in enterprise data analytics, particularly for one-time and complex queries. It highlights the use of Amazon Athena, Amazon Redshift, Amazon Neptune, and dbt to create a unified data modeling language across different platforms. The authors explain how to automate the data lineage generation process using AWS services like Lambda and Step Functions, ensuring accuracy and scalability. The article provides insights into the architecture and implementation details necessary for effective data lineage tracking.
-
product2025-06-24
i don't know "OpenLineage standard" before, I guess Datahub should enable to support it as well.
-
project2024-11-12
-
product2024-12-12
Build a process to built the complete data lineage information by merging the partial lineage generated by dbt automatically.
-
project2024-11-06
Why we load the S3 data into the Redshift again? it already queryable via Redshift Spectrum? I guess it's for the performance? Transform the S3 raw data, build the data models and write back into S3?
-
vision2024-09-18
Fully adapt the SDLC practises for analytic world ...
-
vision2022-02-15
This article is for talk about the idea behind fal dbt, extend the dbt capability on airflow platform. It also talk about a lot of other popular tools on Airflow.
-