exam questions

Exam Certified Data Engineer Professional All Questions

View all questions & answers for the Certified Data Engineer Professional exam

Exam Certified Data Engineer Professional topic 1 question 220 discussion

Actual exam question from Databricks's Certified Data Engineer Professional
Question #: 220
Topic #: 1
[All Certified Data Engineer Professional Questions]

Where in the Spark UI can one diagnose a performance problem induced by not leveraging predicate push-down?

  • A. In the Executor’s log file, by grepping for "predicate push-down"
  • B. In the Stage’s Detail screen, in the Completed Stages table, by noting the size of data read from the Input column
  • C. In the Query Detail screen, by interpreting the Physical Plan
  • D. In the Delta Lake transaction log. by noting the column statistics
Show Suggested Answer Hide Answer
Suggested Answer: C 🗳️

Comments

Chosen Answer:
This is a voting comment (?). It is better to Upvote an existing comment if you don't have anything to add.
Switch to a voting comment New
lakime
1 month, 3 weeks ago
Selected Answer: C
Option C is correct because you can diagnose performance issues related to predicate push-down by examining the Physical Plan in the Query Detail screen of the Spark UI. Predicate push-down is a feature where filtering conditions (predicates) are applied as early as possible, typically in the data scan operation, to reduce the amount of data being read. If predicate push-down is not happening, the physical plan will show that the filter operation is being applied after the data is read, leading to inefficient queries.
upvoted 1 times
...
benni_ale
4 months, 4 weeks ago
Selected Answer: C
Look at the Physical Plan
upvoted 1 times
...
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

SaveCancel
Loading ...
exam
Someone Bought Contributor Access for:
SY0-701
London, 1 minute ago