Exam DP-100 topic 4 question 42 discussion

Actual exam question from Microsoft's DP-100

Question #: 42
Topic #: 4

Note: This question is part of a series of questions that present the same scenario. Each question in the series contains a unique solution that might meet the stated goals. Some question sets might have more than one correct solution, while others might not have a correct solution.

After you answer a question in this section, you will NOT be able to return to it. As a result, these questions will not appear in the review screen.

You create an Azure Machine Learning pipeline named pipeline1 with two steps that contain Python scripts. Data processed by the first step is passed to the second step.

You must update the content of the downstream data source of pipeline1 and run the pipeline again.

You need to ensure the new run of pipeline1 fully processes the updated content.

Solution: Set the allow_reuse parameter of the PythonScriptStep object of both steps to False.

Does the solution meet the goal?

A. Yes
B. No

Show Suggested Answer

Suggested Answer: A 🗳️

by esimsek at March 27, 2023, 10:59 a.m.

Comments

Submit Cancel

PI_Team

1 year, 3 months ago

Yes, the solution meets the goal. Setting the allow_reuse parameter of the PythonScriptStep object of both steps to False will ensure that the new run of pipeline1 fully processes the updated content. When the allow_reuse parameter is set to False, the step will always be re-run, even if its inputs and parameters have not changed. This means that when you update the content of the downstream data source of pipeline1 and run the pipeline again, both steps will be re-run and the updated content will be fully processed. SaM

upvoted 2 times

...

BR_CS

1 year, 3 months ago

Actually I don't get the question as they talk about changing data downstream of pipeline1 in which case there is no reason at all to run the pipeline again. But still, If ensuring that the pipeline runs is the aim, "yes" is the correct answer.

upvoted 1 times

...

snegnik

1 year, 6 months ago

ChatGPT-3.5 The correct solution in this case would be to set the allow_reuse parameter of the PythonScriptStep object of both steps to False. Setting allow_reuse to False ensures that the outputs of the previous run of each step are not reused in subsequent runs. This is important because, in this scenario, the content of the downstream data source has been updated. If allow_reuse is set to True, the pipeline run would reuse the outputs of the previous run, which means it would not fully process the updated content. By setting allow_reuse to False, the pipeline ensures that each step is re-executed, starting from the updated data source. This guarantees that the new run of pipeline1 fully processes the updated content and incorporates the changes made to the downstream data source.

upvoted 1 times

snegnik

1 year, 6 months ago

But I think it is not true. the regenerate_outputs solution focuses on the overall pipeline run and regenerating all outputs, while the allow_reuse solution focuses on individual steps and ensuring their outputs are not reused. In the context of updating the downstream data source and running the pipeline again to fully process the updated content, setting regenerate_outputs to True at the pipeline run submission level would be the appropriate solution. Thuse, the answer is NO.

upvoted 4 times

deyoz

9 months ago

Actually the job of both the parameters are same but are used in different object. allow_reuse is used in PythonScriptStep and regenerate_output is used in Pipeline.submit

upvoted 1 times

...