exam questions

Exam AWS Certified Machine Learning - Specialty All Questions

View all questions & answers for the AWS Certified Machine Learning - Specialty exam

Exam AWS Certified Machine Learning - Specialty topic 1 question 155 discussion

A machine learning (ML) specialist is administering a production Amazon SageMaker endpoint with model monitoring configured. Amazon SageMaker Model
Monitor detects violations on the SageMaker endpoint, so the ML specialist retrains the model with the latest dataset. This dataset is statistically representative of the current production traffic. The ML specialist notices that even after deploying the new SageMaker model and running the first monitoring job, the SageMaker endpoint still has violations.
What should the ML specialist do to resolve the violations?

  • A. Manually trigger the monitoring job to re-evaluate the SageMaker endpoint traffic sample.
  • B. Run the Model Monitor baseline job again on the new training set. Configure Model Monitor to use the new baseline.
  • C. Delete the endpoint and recreate it with the original configuration.
  • D. Retrain the model again by using a combination of the original training set and the new training set.
Show Suggested Answer Hide Answer
Suggested Answer: B 🗳️

Comments

Chosen Answer:
This is a voting comment (?). It is better to Upvote an existing comment if you don't have anything to add.
Switch to a voting comment New
edvardo
Highly Voted 2 years, 6 months ago
I would go with B: https://docs.aws.amazon.com/sagemaker/latest/dg/model-monitor-create-baseline.html
upvoted 6 times
tgaos
2 years, 5 months ago
Agree, the answer is B. From the document, the violation file contains several checks and "The violations file is generated as the output of a MonitoringExecution" . https://docs.aws.amazon.com/sagemaker/latest/dg/model-monitor-interpreting-violations.html.
upvoted 3 times
...
...
AIWave
Most Recent 8 months, 3 weeks ago
Selected Answer: B
The baseline job computes baseline statistics and constraints for the new training set. By using this updated baseline, Model Monitor can better detect any drift or violations in the production traffic.
upvoted 2 times
...
CloudHandsOn
10 months ago
Selected Answer: B
B. Run the Model Monitor baseline job again on the new training set: This is a key step after retraining the model. Since the model has been retrained with a new dataset, the baseline against which its predictions are compared should also be updated. Running the baseline job again on the new training set and configuring Model Monitor to use this new baseline will ensure that the monitoring is relevant to the current state of the model and the data it's processing. D. Retrain the model again with a combination of the original and new training sets: While retraining the model can be a good approach in some scenarios, there's no indication in this case that the issue lies with the model's performance itself. The issue seems to be with the Model Monitor's baseline not aligning with the current model.
upvoted 3 times
...
sukye
11 months, 3 weeks ago
Selected Answer: D
https://docs.aws.amazon.com/sagemaker/latest/dg/model-monitor-interpreting-violations.html
upvoted 1 times
...
Mickey321
1 year, 3 months ago
Selected Answer: B
running the Model Monitor baseline job again on the new training set and configuring Model Monitor to use the new baseline, is the most appropriate step to resolve the violations and ensure the SageMaker endpoint's performance is in line with expectations.
upvoted 1 times
...
AjoseO
1 year, 8 months ago
Selected Answer: B
Running the Model Monitor baseline job again with the new training set and configuring Model Monitor to use the new baseline is a valid option to resolve the violations. By running the baseline job with the new training set, a new baseline is created, which can be used to compare with the new data to detect any drifts in the data distribution. Then, the updated baseline can be set as the new baseline for monitoring the endpoint. So, option B is also a valid solution to resolve the violations.
upvoted 3 times
...
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

SaveCancel
Loading ...
exam
Someone Bought Contributor Access for:
SY0-701
London, 1 minute ago