Exam DP-200 topic 4 question 38 discussion

Actual exam question from Microsoft's DP-200

Question #: 38
Topic #: 4

Note: This question is a part of series of questions that present the same scenario. Each question in the series contains a unique solution. Determine whether the solution meets the stated goals.
You develop data engineering solutions for a company.
A project requires the deployment of resources to Microsoft Azure for batch data processing on Azure HDInsight. Batch processing will run daily and must:
✑ Scale to minimize costs
✑ Be monitored for cluster performance
You need to recommend a tool that will monitor clusters and provide information to suggest how to scale.
Solution: Monitor cluster load using the Ambari Web UI.
Does the solution meet the goal?

A. Yes
B. No

Show Suggested Answer

Suggested Answer: B 🗳️
Ambari Web UI does not provide information to suggest how to scale.
Instead monitor clusters by using Azure Log Analytics and HDInsight cluster management solutions.
References:
https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-oms-log-analytics-tutorial https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-manage-ambari

by Bob123456 at July 16, 2020, 5:12 a.m.

Comments

Submit Cancel

Sennkumar

Highly Voted 4 years, 10 months ago

You can use Ambari to manage and monitor Hadoop clusters but does not provide information on how to scale, hence Azure Log Analytics (this is now called Azure Monitor Logs) is the option to get those information.

upvoted 14 times

...

Alekx42

Most Recent 4 years ago

I can't find any metric in Azure monitor / Log Analytics that allows you to know when to scale an HDInsight cluster. It seems that in Azure monitor you can get some info like CPU and memory usage, but I don't think you actually have something that suggests you when to scale. Unless someone proves me wrong and finds this metric I guess that to know when to scale you should look at statistics related to the nodes of your cluster, which you can do in Ambari. Azure itself suggests using Ambari to monitor the cluster performance: https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-key-scenarios-to-monitor So I suppose that "yes" is the answer.

upvoted 1 times

...

syu31svc

4 years, 6 months ago

https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-manage-ambari I would say yes

upvoted 1 times

...

Bob123456

4 years, 10 months ago

Is the solution to identify (a) Tool that will monitor clusters and provide information to suggest how to scale. ( Or) (b) Just solution to Monitor cluster load using the Ambari Web UI. if it is only for Monitoring it should be option b which is Ambari. The question is confusing me. Can anyone give clarification when to opt Ambari and When to go with "Azure Log Analytics" and "HDInsight cluster management solutions" ??

upvoted 1 times

...