exam questions

Exam AWS Certified Machine Learning - Specialty All Questions

View all questions & answers for the AWS Certified Machine Learning - Specialty exam

Exam AWS Certified Machine Learning - Specialty topic 1 question 247 discussion

A company’s data scientist has trained a new machine learning model that performs better on test data than the company’s existing model performs in the production environment. The data scientist wants to replace the existing model that runs on an Amazon SageMaker endpoint in the production environment. However, the company is concerned that the new model might not work well on the production environment data.

The data scientist needs to perform A/B testing in the production environment to evaluate whether the new model performs well on production environment data.

Which combination of steps must the data scientist take to perform the A/B testing? (Choose two.)

  • A. Create a new endpoint configuration that includes a production variant for each of the two models.
  • B. Create a new endpoint configuration that includes two target variants that point to different endpoints.
  • C. Deploy the new model to the existing endpoint.
  • D. Update the existing endpoint to activate the new model.
  • E. Update the existing endpoint to use the new endpoint configuration.
Show Suggested Answer Hide Answer
Suggested Answer: AE 🗳️

Comments

Chosen Answer:
This is a voting comment (?). It is better to Upvote an existing comment if you don't have anything to add.
Switch to a voting comment New
JonSno
6 months ago
Create a New Endpoint Configuration: Option A: Create a new endpoint configuration that includes a production variant for each of the two models (the existing model and the new model). This allows traffic to be split between the two models, enabling comparative performance analysis. Update the Existing Endpoint: Option E: Update the existing endpoint to use the newly created endpoint configuration. This ensures that both models receive traffic according to the specified distribution, facilitating A/B testing on production data.
upvoted 1 times
...
loict
1 year, 1 month ago
Selected Answer: AE
A. YES - we create a new configuration with 2 production variants (1) B. Create a new endpoint configuration that includes two target variants that point to different endpoints. C. NO - that would defeat A D. NO - that would defeat A E. YES - we modify the existing endpoint to now the new configuration (2)
upvoted 2 times
...
ashii007
1 year, 2 months ago
A & E - supported by docs listed below.
upvoted 1 times
...
Mickey321
1 year, 2 months ago
Selected Answer: AE
A & E ....
upvoted 2 times
...
kaike_reis
1 year, 2 months ago
Selected Answer: AE
Letter A - E are correct for doing the A/B test: We create an endpoint with production variant → We update the existing endpoint. C is wrong, because invalidate Letter A.
upvoted 1 times
...
ADVIT
1 year, 3 months ago
Selected Answer: AE
AE per https://docs.aws.amazon.com/sagemaker/latest/dg/serverless-endpoints-update.html This blog https://aws.amazon.com/blogs/machine-learning/a-b-testing-ml-models-in-production-using-amazon-sagemaker/ Say Deploy just because they deploy two models from the beginning.
upvoted 1 times
...
brianb08
1 year, 4 months ago
Selected Answer: AE
https://docs.aws.amazon.com/sagemaker/latest/dg/serverless-endpoints-update.html E is a better choice than C as it's more specific... the endpoint must be updated to point to the new endpoint configuration.
upvoted 1 times
...
SandeepGun
1 year, 4 months ago
Selected Answer: AC
https://aws.amazon.com/blogs/machine-learning/a-b-testing-ml-models-in-production-using-amazon-sagemaker/
upvoted 1 times
...
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

SaveCancel
Loading ...
exam
Someone Bought Contributor Access for:
SY0-701
London, 1 minute ago