Exam Professional Data Engineer topic 1 question 301 discussion

Actual exam question from Google's Professional Data Engineer

Question #: 301
Topic #: 1

[All Professional Data Engineer Questions]

You are architecting a data transformation solution for BigQuery. Your developers are proficient with SQL and want to use the ELT development technique. In addition, your developers need an intuitive coding environment and the ability to manage SQL as code. You need to identify a solution for your developers to build these pipelines. What should you do?

A. Use Dataform to build, manage, and schedule SQL pipelines.
B. Use Dataflow jobs to read data from Pub/Sub, transform the data, and load the data to BigQuery.
C. Use Data Fusion to build and execute ETL pipelines.
D. Use Cloud Composer to load data and run SQL pipelines by using the BigQuery job operators.

Show Suggested Answer

Suggested Answer: A 🗳️

by rahulvin at Dec. 30, 2023, 9:51 p.m.

Comments

Submit Cancel

raaad

Highly Voted 11 months, 2 weeks ago

Selected Answer: A

- Aligns with ELT Approach: Dataform is designed for ELT (Extract, Load, Transform) pipelines, directly executing SQL transformations within BigQuery, matching the developers' preference. -SQL as Code: It enables developers to write and manage SQL transformations as code, promoting version control, collaboration, and testing. - Intuitive Coding Environment: Dataform provides a user-friendly interface and familiar SQL syntax, making it easy for SQL-proficient developers to adopt. - Scheduling and Orchestration: It includes built-in scheduling capabilities to automate pipeline execution, simplifying pipeline management.

upvoted 8 times

...

Pime13

Most Recent 5 months, 1 week ago

Selected Answer: A

Dataform is designed specifically for building, managing, and scheduling SQL pipelines in BigQuery. It allows developers to use SQL for data transformations, supports version control, and integrates with GitHub and GitLab for managing SQL as code

upvoted 1 times

...