GCP BigQuery

GCP BigQuery

From data warehouse to a unified, AI-ready data platform BigQuery is a fully managed, AI-ready data analytics platform that helps you maximize value from your data and is designed to be multi-engine, multi-format, and multi-cloud.

Web site

Tech tags:

Related shared contents:

  • product
    2025-11-20

    Google Cloud has announced the general availability of Iceberg REST Catalog support in BigLake metastore, enhancing open data interoperability across various data engines. This fully-managed, serverless metastore allows users to query data using their preferred engines, including Apache Spark and BigQuery, without the need for data duplication. The integration with Dataplex Universal Catalog provides comprehensive governance and lineage capabilities. Organizations like Spotify are already leveraging this technology to build modern lakehouse platforms.

  • product
    2025-05-17

    The article discusses the advancements in text-to-SQL capabilities using Google's Gemini models, which allow users to generate SQL queries from natural language prompts. It highlights the challenges faced in understanding user intent, providing business-specific context, and the limitations of large language models in generating precise SQL. Various techniques to improve text-to-SQL performance are explored, including intelligent retrieval of data, disambiguation methods, and validation processes. The article serves as an introduction to a series on enhancing text-to-SQL solutions within Google Cloud products.

  • product
    2025-11-04

    The article announces the preview of the Data Engineering Agent in BigQuery, designed to automate complex data engineering tasks. It highlights how the agent can streamline pipeline development, maintenance, and troubleshooting, allowing data professionals to focus on higher-level tasks. Key features include natural language pipeline creation, intelligent modifications, and integration with Dataplex for enhanced data governance. The article also shares positive feedback from early users, emphasizing the agent's potential to transform data engineering workflows. I would like to see how this help the data modelling tasks, usually DE team don't own this part or need cross ownership this with DA.

  • project
    2025-01-10

    Very classic MDS

  • product
    2025-02-19

    Some good usage of GCP gemini in your data engineering tasks, but I'm concern about my bill of GCP now ^^.

  • tech2
    2022-07-01

    This paper provides an overview of the Data Vault concept and the business benefits of leveraging it on the cloud-based enterprise database BigQuery.

  • product
    2024-08-28

    The article discusses Spotify's approach to creating and managing high-quality dashboards at scale. Spotify utilizes Tableau and Looker Studio as primary tools, supported by a Dashboard Quality Framework that ensures consistency and trust in the dashboards. The framework includes automatic checks ('Vital Signs') and a manual design checklist ('Spicy Dashboard Design'). The Dashboard Portal centralizes dashboard access, offering search, curation, and quality labeling features, enhancing the overall accessibility and reliability of dashboards across the company.

In productions with:

Astrafy