Exam Professional Data Engineer topic 1 question 286 discussion

Actual exam question from Google's Professional Data Engineer

Question #: 286
Topic #: 1

[All Professional Data Engineer Questions]

You have thousands of Apache Spark jobs running in your on-premises Apache Hadoop cluster. You want to migrate the jobs to Google Cloud. You want to use managed services to run your jobs instead of maintaining a long-lived Hadoop cluster yourself. You have a tight timeline and want to keep code changes to a minimum. What should you do?

A. Move your data to BigQuery. Convert your Spark scripts to a SQL-based processing approach.
B. Rewrite your jobs in Apache Beam. Run your jobs in Dataflow.
C. Copy your data to Compute Engine disks. Manage and run your jobs directly on those instances.
D. Move your data to Cloud Storage. Run your jobs on Dataproc.

Show Suggested Answer

Suggested Answer: D 🗳️

by scaenruy at Jan. 4, 2024, 10:41 a.m.

Comments

Submit Cancel

hussain.sain

5 months, 3 weeks ago

Selected Answer: D

D is correct. Dataproc is the most suitable choice for migrating your existing Apache Spark jobs to Google Cloud because it is a fully managed service that supports Apache Spark and Hadoop workloads with minimal changes to your existing code. Moving your data to Cloud Storage and running jobs on Dataproc offers a fast, efficient, and scalable solution for your needs.

upvoted 1 times

...