Exam DP-201 topic 1 question 47 discussion

Actual exam question from Microsoft's DP-201

Question #: 47
Topic #: 1

You are designing a streaming solution that must meet the following requirements:
✑ Accept input data from an Azure IoT hub.
✑ Write aggregated data to Azure Cosmos DB.
✑ Calculate minimum, maximum, and average sensor readings every five minutes.
✑ Define calculations by using a SQL query.
✑ Deploy to multiple environments by using Azure Resource Manager templates.
What should you include in the solution?

A. Azure Functions
B. Azure HDInsight with Spark Streaming
C. Azure Databricks
D. Azure Stream Analytics

Show Suggested Answer

Suggested Answer: C 🗳️
Cosmos DB is ideally suited for IoT solutions. Cosmos DB can ingest device telemetry data at high rates.

Architecture -

Data flow -
1. Events generated from IoT devices are sent to the analyze and transform layer through Azure IoT Hub as a stream of messages. Azure IoT Hub stores streams of data in partitions for a configurable amount of time.
2. Azure Databricks, running Apache Spark Streaming, picks up the messages in real time from IoT Hub, processes the data based on the business logic and sends the data to Serving layer for storage. Spark Streaming can provide real time analytics such as calculating moving averages, min and max values over time periods.
3. Device messages are stored in Cosmos DB as JSON documents.
Reference:
https://docs.microsoft.com/en-us/azure/architecture/solution-ideas/articles/iot-using-cosmos-db

by SK1984 at April 3, 2021, 12:14 p.m.

Comments

Submit Cancel

suman13

Highly Voted 4 years, 2 months ago

ARM template can only be used to create databricks workspace but not for the application(notebooks),cluster etc. whereas it can be used for stream analytics. Hence Stream Analytics should be the answer here

upvoted 32 times

...

KRV

Highly Voted 4 years, 2 months ago

Since the question clearly specifies to define calculations by using a SQL query as well as the points that minimum, maximum, and average sensor readings are to be calculated every five minutes using Windows functions within the Azure stream analytics would be a straight and preffered option. One can always use Azure Databricks , however for minimal code using SQL and windows functions , the best possible solution ideally should be Azure Stream Analytics.

upvoted 13 times

...

Ankush1994

Most Recent 3 years, 9 months ago

Azure Databricks, running Apache Spark Streaming, picks up the messages in real time from IoT Hub, processes the data based on the business logic and sends the data to Serving layer for storage.

upvoted 1 times

...

tes

3 years, 11 months ago

In the link given there is an alternatives section which states for streaming Stream Analytics could be used as an alternative. So that is another plus to the argument that Stream Analytics should be the answer.

upvoted 1 times

...

davem0193

3 years, 11 months ago

The architectural diagram provided as part of the solution clearly shows that it needs to be databricks although Stream analytics makes more sense. Solution provided is correct - it is databricks

upvoted 1 times

tes

3 years, 11 months ago

in the same page alternatives are provided and one is stream analytics. ARM template deploy of jobs are possible there. Where as DBR notebooks cannot be deployed through arm templates

upvoted 2 times

...