Exam Certified Data Engineer Associate topic 1 question 80 discussion

Actual exam question from Databricks's Certified Data Engineer Associate

Question #: 80
Topic #: 1

[All Certified Data Engineer Associate Questions]

A dataset has been defined using Delta Live Tables and includes an expectations clause:

CONSTRAINT valid_timestamp EXPECT (timestamp > '2020-01-01') ON VIOLATION FAIL UPDATE

What is the expected behavior when a batch of data containing data that violates these constraints is processed?

A. Records that violate the expectation are dropped from the target dataset and recorded as invalid in the event log.
B. Records that violate the expectation cause the job to fail.
C. Records that violate the expectation are dropped from the target dataset and loaded into a quarantine table.
D. Records that violate the expectation are added to the target dataset and recorded as invalid in the event log.
E. Records that violate the expectation are added to the target dataset and flagged as invalid in a field added to the target dataset.

Show Suggested Answer

Suggested Answer: B 🗳️

by meow_akk at Oct. 22, 2023, 5:46 a.m.

Comments

Submit Cancel

CommanderBigMac

9 months, 3 weeks ago

Selected Answer: B

B is the way

upvoted 1 times

...

benni_ale

1 year, 2 months ago

Selected Answer: B

b is ok

upvoted 1 times

...

55f31c8

1 year, 7 months ago

Selected Answer: B

https://docs.databricks.com/en/delta-live-tables/sql-ref.html#sql-properties ON VIOLATION Optional action to take for failed rows: FAIL UPDATE: Immediately stop pipeline execution. DROP ROW: Drop the record and continue processing.

upvoted 2 times

...

Bakhtiyor

1 year, 7 months ago

ON VIOLATION FAIL UPDATE: Immediately stop pipeline execution. DROP ROW: Drop the record and continue processing.

upvoted 2 times

...

meow_akk

1 year, 8 months ago

Ans B : delta live tables data quality expectations . - https://docs.databricks.com/en/delta-live-tables/expectations.html Action Result warn (default) Invalid records are written to the target; failure is reported as a metric for the dataset. drop Invalid records are dropped before data is written to the target; failure is reported as a metrics for the dataset. fail Invalid records prevent the update from succeeding. Manual intervention is required before re-processing.

upvoted 4 times

...