Exam Certified Data Engineer Professional topic 1 question 81 discussion

Actual exam question from Databricks's Certified Data Engineer Professional

Question #: 81
Topic #: 1

[All Certified Data Engineer Professional Questions]

A CHECK constraint has been successfully added to the Delta table named activity_details using the following logic:

A batch job is attempting to insert new records to the table, including a record where latitude = 45.50 and longitude = 212.67.

Which statement describes the outcome of this batch insert?

A. The write will fail when the violating record is reached; any records previously processed will be recorded to the target table.
B. The write will fail completely because of the constraint violation and no records will be inserted into the target table.
C. The write will insert all records except those that violate the table constraints; the violating records will be recorded to a quarantine table.
D. The write will include all records in the target table; any violations will be indicated in the boolean column named valid_coordinates.
E. The write will insert all records except those that violate the table constraints; the violating records will be reported in a warning log.

Show Suggested Answer

Suggested Answer: B 🗳️

by PearApple at Oct. 21, 2023, 8:07 p.m.

Comments

Submit Cancel

aragorn_brego

Highly Voted 1 year, 2 months ago

Selected Answer: B

In systems that support atomic transactions, such as Delta Lake, when a batch operation encounters a record that violates a CHECK constraint, the entire operation fails, and no records are inserted, including those that do not violate the constraint. This is to ensure the atomicity of the transaction, meaning that either all the changes are committed, or none are, maintaining data integrity. The record with a longitude of 212.67 violates the constraint because longitude values must be between -180 and 180 degrees.

upvoted 5 times

...

vctrhugo

Highly Voted 12 months ago

Selected Answer: B

In Delta Lake, when a batch job attempts to insert records into a table that has a CHECK constraint, if any record violates the constraint, the entire write operation fails. This is because Delta Lake enforces strong transactional guarantees, which means that either all changes in a transaction are saved, or none are.

upvoted 5 times

...