Exam AWS Certified Data Engineer - Associate DEA-C01 topic 1 question 73 discussion

Exam question from Amazon's AWS Certified Data Engineer - Associate DEA-C01

Question #: 73
Topic #: 1

[All AWS Certified Data Engineer - Associate DEA-C01 Questions]

A company receives a daily file that contains customer data in .xls format. The company stores the file in Amazon S3. The daily file is approximately 2 GB in size.
A data engineer concatenates the column in the file that contains customer first names and the column that contains customer last names. The data engineer needs to determine the number of distinct customers in the file.
Which solution will meet this requirement with the LEAST operational effort?

A. Create and run an Apache Spark job in an AWS Glue notebook. Configure the job to read the S3 file and calculate the number of distinct customers.
B. Create an AWS Glue crawler to create an AWS Glue Data Catalog of the S3 file. Run SQL queries from Amazon Athena to calculate the number of distinct customers.
C. Create and run an Apache Spark job in Amazon EMR Serverless to calculate the number of distinct customers.
D. Use AWS Glue DataBrew to create a recipe that uses the COUNT_DISTINCT aggregate function to calculate the number of distinct customers.

Show Suggested Answer

Suggested Answer: D 🗳️

by rralucard_ at Feb. 2, 2024, 2:07 p.m.

Disclaimers:

- ExamTopics website is not related to, affiliated with, endorsed or authorized by Amazon.
- Trademarks, certification & product names are used for reference only and belong to Amazon.

Comments

Submit Cancel

rralucard_

Highly Voted 1 year, 4 months ago

Selected Answer: D

AWS Glue DataBrew: AWS Glue DataBrew is a visual data preparation tool that allows data engineers and data analysts to clean and normalize data without writing code. Using DataBrew, a data engineer could create a recipe that includes the concatenation of the customer first and last names and then use the COUNT_DISTINCT function. This would not require complex code and could be performed through the DataBrew user interface, representing a lower operational effort.

upvoted 9 times

...

Juan_pc

Most Recent 1 month, 3 weeks ago

Selected Answer: A

According to the official DataBrew documentation, it does not natively support files in .xls format (it does support .xlsx). The correct option is A.

upvoted 1 times

...

pypelyncar

1 year ago

Selected Answer: D

DataBrew supports various transformations, including the COUNT_DISTINCT function, which is ideal for calculating the number of unique values in a column (combined first and last names in this case).

upvoted 2 times

...

Ousseyni

1 year, 2 months ago

Selected Answer: D

go in D

upvoted 2 times

...

lucas_rfsb

1 year, 2 months ago

Selected Answer: D

since it's less operational effort, I would go in D

upvoted 2 times

...