Exam DP-201 topic 2 question 20 discussion

Actual exam question from Microsoft's DP-201

Question #: 20
Topic #: 2

Note: This question is part of a series of questions that present the same scenario. Each question in the series contains a unique solution that might meet the stated goals. Some question sets might have more than one correct solution, while others might not have a correct solution.
After you answer a question in this section, you will NOT be able to return to it. As a result, these questions will not appear in the review screen.
You have an Azure Data Lake Storage account that contains a staging zone.
You need to design a daily process to ingest incremental data from the staging zone, transform the data by executing an R script, and then insert the transformed data into a data warehouse in Azure Synapse Analytics.
Solution: You use an Azure Data Factory schedule trigger to execute a pipeline that copies the data to a staging table in the data warehouse, and then uses a stored procedure to execute the R script.
Does this meet the goal?

A. Yes
B. No

Show Suggested Answer

Suggested Answer: A 🗳️
If you need to transform data in a way that is not supported by Data Factory, you can create a custom activity with your own data processing logic and use the activity in the pipeline. You can create a custom activity to run R scripts on your HDInsight cluster with R installed.
Reference:
https://docs.microsoft.com/en-US/azure/data-factory/transform-data

by Nieswurz at Aug. 17, 2020, 1:25 p.m.

Comments

Submit Cancel

Nieswurz

Highly Voted 4 years, 9 months ago

The proposed solution seems to let the R function do the loading into Synapse. The answer then should be 'no', but more likely the description seems again to be incomplete.

upvoted 16 times

Pairon

4 years, 2 months ago

I agree with you. The insert operation into the DWH should be come after the R script process.

upvoted 2 times

...

cadio30

4 years ago

Agree with the statement and as of this year, the Azure Synapse doesn't support R language unless it is executed against Azure SQL Manage Instance

upvoted 5 times

...

azurrematt123

Most Recent 3 years, 11 months ago

Looks like executing R is possible(sp_execute_external_script), please review the link. https://docs.microsoft.com/en-us/sql/relational-databases/system-stored-procedures/sp-execute-external-script-transact-sql?view=sql-server-ver15

upvoted 2 times

azurrematt123

3 years, 11 months ago

My bad it only applies to SQL Server 2016 & Azure SQL Managed Instance, Moderator please dont post this.

upvoted 1 times

tes

3 years, 11 months ago

there is no moderator human

upvoted 1 times

...

4 years, 9 months ago

The explanation of the answer contains R on an HDInsight-Cluster. This kind of solution is stated to be incorrect in another questions explanation - in favor of an Azure function.

upvoted 2 times

...