Exam DP-203 topic 2 question 102 discussion

Actual exam question from Microsoft's DP-203

Question #: 102
Topic #: 2

HOTSPOT
-

You have two Azure SQL databases named DB1 and DB2.

DB1 contains a table named Table1. Table1 contains a timestamp column named LastModifiedOn. LastModifiedOn contains the timestamp of the most recent update for each individual row.

DB2 contains a table named Watermark. Watermark contains a single timestamp column named WatermarkValue.

You plan to create an Azure Data Factory pipeline that will incrementally upload into Azure Blob Storage all the rows in Table1 for which the LastModifiedOn column contains a timestamp newer than the most recent value of the WatermarkValue column in Watermark.

You need to identify which activities to include in the pipeline. The solution must meet the following requirements:

• Minimize the effort to author the pipeline.
• Ensure that the number of data integration units allocated to the upload operation can be controlled.

What should you identify? To answer, select the appropriate options in the answer area.

NOTE: Each correct answer is worth one point.

Show Suggested Answer

Suggested Answer:

by [deleted] at May 8, 2023, 9:42 a.m.

Comments

Submit Cancel

DarKru

Highly Voted 2 years ago

Correct. The example is here https://learn.microsoft.com/en-us/azure/data-factory/tutorial-incremental-copy-portal

upvoted 15 times

...

[Removed]

Highly Voted 2 years, 1 month ago

Seems correct to me

upvoted 11 times

...

CezarioAbrantesPP

Most Recent 11 months, 1 week ago

Create a pipeline with the following workflow: The pipeline in this solution has the following activities: Create two Lookup activities. Use the first Lookup activity to retrieve the last watermark value. Use the second Lookup activity to retrieve the new watermark value. These watermark values are passed to the Copy activity. Create a Copy activity that copies rows from the source data store with the value of the watermark column greater than the old watermark value and less than the new watermark value. Then, it copies the delta data from the source data store to Blob storage as a new file. Create a StoredProcedure activity that updates the watermark value for the pipeline that runs next time.

upvoted 3 times

...

Alongi

1 year, 1 month ago

I found this question on my exam 30/04/2024, and I put - LOOKUP - DATAFLOW I passed the exam with a high score, but I'm not sure if the answer is correct.

upvoted 2 times

e56bb91

11 months, 1 week ago

you will get higher score if you choose Lookup and Copy

upvoted 3 times

...

kkk5566

1 year, 9 months ago

lookup & copy activity

upvoted 1 times

...

haythemsi

2 years ago

Filter not lookup, because we have to "Minimize the effort to author the pipeline" and we have only the LastModifiedOn column as information, we are not sure for lookup.

upvoted 3 times

auwia

1 year, 11 months ago

The Filter activity in Azure Data Factory is used to filter an array of objects from a previous activity's output (typically from a Lookup activity). It cannot directly query a database or compare a value from a database (watermark in this case) against data in another database.

upvoted 5 times

...