ExamTopics Logo
Mail Us[email protected]
Menu
Databricks Discussions
exam questions

Exam Certified Data Engineer Professional All Questions

View all questions & answers for the Certified Data Engineer Professional exam
Go to Exam

Exam Certified Data Engineer Professional topic 1 question 114 discussion

Actual exam question from Databricks's Certified Data Engineer Professional
Question #: 114
Topic #: 1
[All Certified Data Engineer Professional Questions]

A data team’s Structured Streaming job is configured to calculate running aggregates for item sales to update a downstream marketing dashboard. The marketing team has introduced a new promotion, and they would like to add a new field to track the number of times this promotion code is used for each item. A junior data engineer suggests updating the existing query as follows. Note that proposed changes are in bold.

Original query:



Proposed query:



Which step must also be completed to put the proposed query into production?

  • A. Specify a new checkpointLocation
  • B. Remove .option('mergeSchema', 'true') from the streaming write
  • C. Increase the shuffle partitions to account for additional aggregates
  • D. Run REFRESH TABLE delta.‛/item_agg‛
Show Suggested Answer Hide Answer
Suggested Answer: A 🗳️
by MDWPartners at May 29, 2024, 5:55 p.m.

Comments

Chosen Answer:
This is a voting comment (?). It is better to Upvote an existing comment if you don't have anything to add.
Switch to a voting comment New
Submit Cancel
Deb9753
Highly Voted 10 months, 4 weeks ago
Answer: A When updating the schema of a streaming job, specifying a new checkpoint location ensures that the streaming query starts fresh with the new schema. This avoids issues that might arise from schema mismatches between the previous state and the new schema. This is especially relevant when adding new fields because the existing state might not be compatible with the new schema.
upvoted 5 times
...
SeRo42
Most Recent 3 months, 1 week ago
Selected Answer: A
Are filter conditions in count() allowed?
upvoted 1 times
...
robodog
8 months, 1 week ago
Selected Answer: A
A answer
upvoted 1 times
...
MDWPartners
11 months ago
Selected Answer: A
This checkpoint location preserves all of the essential information that identifies a query. Each query must have a different checkpoint location. Multiple queries should never have the same location. For more information, see the Structured Streaming Programming Guide. https://docs.databricks.com/en/structured-streaming/query-recovery.html
upvoted 2 times
...
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

SaveCancel
exam
Someone Bought Contributor Access for:
SY0-701
London, 1 minute ago