Exam Professional Data Engineer topic 1 question 145 discussion

Actual exam question from Google's Professional Data Engineer

Question #: 145
Topic #: 1

[All Professional Data Engineer Questions]

You receive data files in CSV format monthly from a third party. You need to cleanse this data, but every third month the schema of the files changes. Your requirements for implementing these transformations include:
✑ Executing the transformations on a schedule
✑ Enabling non-developer analysts to modify transformations
✑ Providing a graphical tool for designing transformations
What should you do?

A. Use Dataprep by Trifacta to build and maintain the transformation recipes, and execute them on a scheduled basis
B. Load each month's CSV data into BigQuery, and write a SQL query to transform the data to a standard schema. Merge the transformed tables together with a SQL query
C. Help the analysts write a Dataflow pipeline in Python to perform the transformation. The Python code should be stored in a revision control system and modified as the incoming data's schema changes
D. Use Apache Spark on Dataproc to infer the schema of the CSV file before creating a Dataframe. Then implement the transformations in Spark SQL before writing the data out to Cloud Storage and loading into BigQuery

Show Suggested Answer

Suggested Answer: A 🗳️

by madhu1171 at March 15, 2020, 5:07 p.m.

Comments

Submit Cancel

madhu1171

Highly Voted 4 years, 9 months ago

A should be the answer

upvoted 35 times

...

[Removed]

Highly Voted 4 years, 8 months ago

Answer: A Description: Dataprep is used by non developers

upvoted 18 times

...

CGS22

Most Recent 8 months, 2 weeks ago

Selected Answer: A

A. Use Dataprep by Trifacta to build and maintain the transformation recipes, and execute them on a scheduled basis Addresses Requirements: Scheduled Execution: Dataprep supports running transformations on a schedule. Analyst-Friendly: Dataprep's visual interface is designed for non-developer analysts to build and modify transformations easily. Graphical Tool: It provides a drag-and-drop environment for designing data transformations. Schema Flexibility: Dataprep can handle schema changes. Analysts can adapt recipes using the visual interface

upvoted 2 times

...

barnac1es

1 year, 2 months ago

Selected Answer: A

Scheduled Transformations: Dataprep by Trifacta allows you to design and schedule transformation recipes to process data on a regular basis. You can automate the data cleansing process by scheduling it to run monthly. User-Friendly Interface: Dataprep provides a user-friendly graphical interface that enables non-developer analysts to design, modify, and maintain transformation recipes without writing code. This empowers analysts to work with the data effectively. Transformation Flexibility: Dataprep supports flexible data transformations, making it suitable for scenarios where the schema of the incoming data changes. Analysts can adapt the transformations to new schemas using the visual tools provided by Dataprep.

upvoted 1 times

...

vaga1

1 year, 7 months ago

Selected Answer: A

Providing a graphical tool for designing transformations is enough for A

upvoted 4 times

...

Dhruv28

1 year, 9 months ago

Your company receives a lot of financial data in CSV files. The files need to be processed, cleaned and transformed before they are made available for analytics. The schema of the data also changes every third month. The Data analysts should be able to perform the tasks 1. No prior knowledge of any language with no coding 2. Provided a GUI tool to build and modify the schema What solution best fits the need?

upvoted 1 times

...

zellck

2 years ago

Selected Answer: A

A is the answer. https://cloud.google.com/dataprep Dataprep by Trifacta is an intelligent data service for visually exploring, cleaning, and preparing structured and unstructured data for analysis, reporting, and machine learning. Because Dataprep is serverless and works at any scale, there is no infrastructure to deploy or manage. Your next ideal data transformation is suggested and predicted with each UI input, so you don’t have to write code.

upvoted 3 times

...