Amazon Redshift is a data warehouse product
Tech tags:
Related shared contents:
-
project2026-03-03
The article details Yggdrasil Gaming's migration from Google BigQuery to an AWS-based lakehouse architecture, highlighting the challenges faced due to multi-cloud operational complexity and the need for a scalable analytics foundation. It outlines the phased approach taken to establish a new architecture using AWS services, including Amazon S3, Apache Iceberg, and Amazon Athena, which enabled real-time data ingestion and advanced analytics capabilities. The migration resulted in significant cost savings, improved data freshness, and enhanced governance for analytics workloads. The article serves as a case study for organizations looking to modernize their data architecture.
-
project2026-01-30
The article outlines Halodoc's comprehensive approach to data validation within a Lakehouse architecture, emphasizing the importance of data accuracy and reliability. It describes a multi-layered validation strategy that employs AI to enhance data quality checks at various stages of the data pipeline. The validation layers include checks for data consistency, structural correctness, business correctness, and reconciliation, ensuring that data remains trustworthy throughout its journey. The implementation of this strategy has led to reduced data incidents and increased trust among analytics and product teams.
-
tech22024-12-12
This article discusses the challenges and solutions for building end-to-end data lineage in enterprise data analytics, particularly for one-time and complex queries. It highlights the use of Amazon Athena, Amazon Redshift, Amazon Neptune, and dbt to create a unified data modeling language across different platforms. The authors explain how to automate the data lineage generation process using AWS services like Lambda and Step Functions, ensuring accuracy and scalability. The article provides insights into the architecture and implementation details necessary for effective data lineage tracking.
-
product2025-05-20
Interested to know when an Amazon Bedrock knowledge base for the Redshift database, how to open the access for Apps with nature language.
-
project2024-12-05
Twitch has leveraged Views in their Data Lake to enhance data agility, minimize downtime, and streamline development workflows. By utilizing Views as interfaces to underlying data tables, they've enabled seamless schema modifications, such as column renames and VARCHAR resizing, without necessitating data reprocessing. This approach has facilitated rapid responses to data quality issues and supported efficient ETL processes, contributing to a scalable and adaptable data infrastructure.
-
product2024-12-12
Build a process to built the complete data lineage information by merging the partial lineage generated by dbt automatically.
-
project2024-11-06
Why we load the S3 data into the Redshift again? it already queryable via Redshift Spectrum? I guess it's for the performance? Transform the S3 raw data, build the data models and write back into S3?
-
poc2021-12-27