ExamTopics Logo
Mail Us[email protected]
Menu
Amazon Discussions
exam questions

Exam AWS Certified Machine Learning - Specialty All Questions

View all questions & answers for the AWS Certified Machine Learning - Specialty exam
Go to Exam

Exam AWS Certified Machine Learning - Specialty topic 1 question 343 discussion

Exam question from Amazon's AWS Certified Machine Learning - Specialty
Question #: 343
Topic #: 1
[All AWS Certified Machine Learning - Specialty Questions]

A telecommunications company has deployed a machine learning model using Amazon SageMaker. The model identifies customers who are likely to cancel their contract when calling customer service. These customers are then directed to a specialist service team. The model has been trained on historical data from multiple years relating to customer contracts and customer service interactions in a single geographic region.

The company is planning to launch a new global product that will use this model. Management is concerned that the model might incorrectly direct a large number of calls from customers in regions without historical data to the specialist service team.

Which approach would MOST effectively address this issue?

  • A. Enable Amazon SageMaker Model Monitor data capture on the model endpoint. Create a monitoring baseline on the training dataset. Schedule monitoring jobs. Use Amazon CloudWatch to alert the data scientists when the numerical distance of regional customer data fails the baseline drift check. Reevaluate the training set with the larger data source and retrain the model.
  • B. Enable Amazon SageMaker Debugger on the model endpoint. Create a custom rule to measure the variance from the baseline training dataset. Use Amazon CloudWatch to alert the data scientists when the rule is invoked. Reevaluate the training set with the larger data source and retrain the model.
  • C. Capture all customer calls routed to the specialist service team in Amazon S3. Schedule a monitoring job to capture all the true positives and true negatives, correlate them to the training dataset, and calculate the accuracy. Use Amazon CloudWatch to alert the data scientists when the accuracy decreases. Reevaluate the training set with the additional data from the specialist service team and retrain the model.
  • D. Enable Amazon CloudWatch on the model endpoint. Capture metrics using Amazon CloudWatch Logs and send them to Amazon S3. Analyze the monitored results against the training data baseline. When the variance from the baseline exceeds the regional customer variance, reevaluate the training set and retrain the model.
Show Suggested Answer Hide Answer
Suggested Answer: A 🗳️
by MultiCloudIronMan at Sept. 22, 2024, 5:36 p.m.
Disclaimers:
  • - ExamTopics website is not related to, affiliated with, endorsed or authorized by Amazon.
  • - Trademarks, certification & product names are used for reference only and belong to Amazon.

Comments

Chosen Answer:
This is a voting comment (?). It is better to Upvote an existing comment if you don't have anything to add.
Switch to a voting comment New
Submit Cancel
2eb8df0
1 month, 2 weeks ago
Selected Answer: C
I have no idea what "larger data source" they are referring to in A, B. C is the only one that: - Records misclassified calls from new regions (true positives & true negatives). - Tracks accuracy changes over time to detect model degradation. - Uses real-world customer interactions from different regions to improve the model. - Retrains the model with this expanded dataset, making it more globally relevant. So im going with C
upvoted 1 times
ef12052
1 month, 2 weeks ago
why you need s3?
upvoted 1 times
2eb8df0
1 month, 2 weeks ago
Where is A larger data source?
upvoted 1 times
ef12052
1 month, 1 week ago
larger is past training data + new data...
upvoted 1 times
...
...
...
...
7f1fe73
6 months, 1 week ago
Selected Answer: A
Option A is the most comprehensive and proactive approach, ensuring continuous monitoring and timely alerts for data drift, which is crucial for maintaining model accuracy across different regions.
upvoted 1 times
...
MultiCloudIronMan
7 months, 2 weeks ago
Selected Answer: A
from copilot - Option A is the most comprehensive and proactive approach, ensuring continuous monitoring and timely alerts for data drift, which is crucial for maintaining model accuracy across different regions.
upvoted 1 times
...
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

SaveCancel
exam
Someone Bought Contributor Access for:
SY0-701
London, 1 minute ago