Exam Professional Data Engineer topic 1 question 199 discussion

A. Use BigQuery BI Engine with materialized views.

A is the answer. https://cloud.google.com/bigquery/docs/materialized-views-intro In BigQuery, materialized views are precomputed views that periodically cache the results of a query for increased performance and efficiency. BigQuery leverages precomputed results from materialized views and whenever possible reads only delta changes from the base tables to compute up-to-date results. Materialized views can be queried directly or can be used by the BigQuery optimizer to process queries to the base tables. Queries that use materialized views are generally faster and consume fewer resources than queries that retrieve the same data only from the base tables. Materialized views can significantly improve the performance of workloads that have the characteristic of common and repeated queries.

Option A is the better one. But keep in mind for real life: https://cloud.google.com/bigquery/docs/bi-engine-preferred-tables Limitations BI Engine preferred tables have the following limitations: You cannot add views into the preferred tables reservation list. BI Engine preferred tables only support tables. Queries to materialized views are only accelerated if both the materialized views and their base tables are in the preferred tables list.

Materialized views are precomputed query results that are stored in memory, allowing for faster retrieval of aggregated data. When you create a materialized view in BigQuery, it stores the results of a query as a table, and subsequent queries that can leverage this materialized view can be significantly faster compared to computing them on the fly.

periodically cache the results for perfomance

A. https://cloud.google.com/bigquery/docs/materialized-views-intro In BigQuery, materialized views are precomputed views that periodically cache the results of a query for increased performance and efficiency

I vote A https://cloud.google.com/bigquery/docs/bi-engine-intro#:~:text=Materialized%20views%20%2D%20Materialized%20views%20in%20BigQuery%20perform%20precomputation%2C%20thereby%20reducing%20query%20time.%20You%20should%20create%20materialized%20views%20to%20improve%20performance%20and%20to%20reduce%20processed%20data%20by%20using%20aggregations%2C%20filters%2C%20inner%20joins%2C%20and%20unnests.

use materialized views is better option here

By integrating BI Engine with BigQuery streaming, you can perform real-time data analysis over streaming data without sacrificing write speeds or data freshness. https://cloud.google.com/bigquery/docs/bi-engine-intro