Exam Professional Data Engineer topic 1 question 230 discussion

Actual exam question from Google's Professional Data Engineer

Question #: 230
Topic #: 1

[All Professional Data Engineer Questions]

You need to modernize your existing on-premises data strategy. Your organization currently uses:
• Apache Hadoop clusters for processing multiple large data sets, including on-premises Hadoop Distributed File System (HDFS) for data replication.
• Apache Airflow to orchestrate hundreds of ETL pipelines with thousands of job steps.

You need to set up a new architecture in Google Cloud that can handle your Hadoop workloads and requires minimal changes to your existing orchestration processes. What should you do?

A. Use Bigtable for your large workloads, with connections to Cloud Storage to handle any HDFS use cases. Orchestrate your pipelines with Cloud Composer.
B. Use Dataproc to migrate Hadoop clusters to Google Cloud, and Cloud Storage to handle any HDFS use cases. Orchestrate your pipelines with Cloud Composer.
C. Use Dataproc to migrate Hadoop clusters to Google Cloud, and Cloud Storage to handle any HDFS use cases. Convert your ETL pipelines to Dataflow.
D. Use Dataproc to migrate your Hadoop clusters to Google Cloud, and Cloud Storage to handle any HDFS use cases. Use Cloud Data Fusion to visually design and deploy your ETL pipelines.

Show Suggested Answer

Suggested Answer: B 🗳️

by scaenruy at Jan. 3, 2024, 12:43 p.m.

Comments

Submit Cancel

raaad

Highly Voted 1 year, 1 month ago

Selected Answer: B

Straight forward

upvoted 7 times

...

datasmg

Most Recent 11 months ago

Selected Answer: B

You can use Dataproc for doing Apache Hadoop process, then Cloud Storage to replace the HDFS, and using Cloud Composer (built in Apache Airflow) for orchestrator.

upvoted 1 times

...