Welcome to ExamTopics
ExamTopics Logo
- Expert Verified, Online, Free.
Mail Us[email protected]
Menu

Unlimited Access

Get Unlimited Contributor Access to the all ExamTopics Exams!
Take advantage of PDF Files for 1000+ Exams along with community discussions and pass IT Certification Exams Easily.
Amazon Discussions

Exam AWS Certified Machine Learning - Specialty topic 1 question 40 discussion

Exam question from Amazon's AWS Certified Machine Learning - Specialty
Question #: 40
Topic #: 1
[All AWS Certified Machine Learning - Specialty Questions]

A Machine Learning team uses Amazon SageMaker to train an Apache MXNet handwritten digit classifier model using a research dataset. The team wants to receive a notification when the model is overfitting. Auditors want to view the Amazon SageMaker log activity report to ensure there are no unauthorized API calls.
What should the Machine Learning team do to address the requirements with the least amount of code and fewest steps?

  • A. Implement an AWS Lambda function to log Amazon SageMaker API calls to Amazon S3. Add code to push a custom metric to Amazon CloudWatch. Create an alarm in CloudWatch with Amazon SNS to receive a notification when the model is overfitting.
  • B. Use AWS CloudTrail to log Amazon SageMaker API calls to Amazon S3. Add code to push a custom metric to Amazon CloudWatch. Create an alarm in CloudWatch with Amazon SNS to receive a notification when the model is overfitting.
  • C. Implement an AWS Lambda function to log Amazon SageMaker API calls to AWS CloudTrail. Add code to push a custom metric to Amazon CloudWatch. Create an alarm in CloudWatch with Amazon SNS to receive a notification when the model is overfitting.
  • D. Use AWS CloudTrail to log Amazon SageMaker API calls to Amazon S3. Set up Amazon SNS to receive a notification when the model is overfitting
Show Suggested Answer Hide Answer
Suggested Answer: B 🗳️
by DonaldCMLIN at Nov. 16, 2019, 10:02 a.m.
Disclaimers:
  • - ExamTopics website is not related to, affiliated with, endorsed or authorized by Amazon.
  • - Trademarks, certification & product names are used for reference only and belong to Amazon.

Comments

Chosen Answer:
This is a voting comment (?) , you can switch to a simple comment.
Switch to a voting comment New
Submit Cancel
DonaldCMLIN
Highly Voted 2 years, 8 months ago
THE ANSWER SHOULD BE B. YOU DON'T NEED TO THROUGH LAMBDA TO INTERGE CLOUDTRAIL Log Amazon SageMaker API Calls with AWS CloudTrail https://docs.aws.amazon.com/sagemaker/latest/dg/logging-using-cloudtrail.html
upvoted 41 times
...
rajs
Highly Voted 2 years, 7 months ago
Agreed B for the following reasons # CloudTrail logs captured in S3 without any code/lambda # The custom metrics can be published to Cloudwatch...in this case it would be a test for overfit on MXNET .... which will set off an alarm .... which can then be subscribed on SNS
upvoted 11 times
...
Chiquitabandita
Most Recent 3 weeks, 1 day ago
Selected Answer: D
https://docs.aws.amazon.com/fr_fr/sagemaker/latest/dg/training-metrics.html#define-train-metrics It detects hardware resource usage issues (such as CPU, GPU, and I/O bottlenecks) and non-convergent model issues (such as overfitting, disappearing gradients, and tensor explosion). why couldn't the answer be D, as this covers all of the requirements, and B seems to add an extra step with adding push code, when it already has a builtin metric for overfitting.
upvoted 1 times
Aja1
3 weeks ago
Custom metric Need to built and pushed.
upvoted 1 times
...
...
loict
8 months, 1 week ago
Selected Answer: B
A. NO - CloudTrail has built-in SageMaker API calls tracking, no lambda needed B. YES - the chain works C. NO - CloudTrail has built-in SageMaker API calls tracking, no lambda needed D. NO - CloudTrail has not specific Amazon SageMaker integration to detect overfitting
upvoted 1 times
...
Mickey321
8 months, 3 weeks ago
Selected Answer: B
Option B
upvoted 1 times
...
ADVIT
10 months, 3 weeks ago
"least amount of code and fewest steps?" I think it's D.
upvoted 2 times
kukreti18
10 months, 1 week ago
Agreed, with less code effort.
upvoted 1 times
...
...
Paolo991
1 year, 1 month ago
I would consider D as well. You can just setup a SNS that is triggered by a built-in action like here: https://docs.aws.amazon.com/sagemaker/latest/dg/debugger-built-in-actions.html You can see that overfitting is a built-in rule for MXNet from here: https://docs.aws.amazon.com/sagemaker/latest/dg/debugger-built-in-rules.html Not that B is not working. Maybe the question was prior to this new solution.
upvoted 2 times
khchan123
6 months, 1 week ago
The loss_not_decreasing, overfit, overtraining, and stalled_training_rule monitors if your model is optimizing the loss function without those training issues. If the rules detect training anomalies, the rule evaluation status changes to IssueFound. You can set up automated actions, such as notifying training issues and stopping training jobs using Amazon CloudWatch Events and AWS Lambda. For more information, see Action on Amazon SageMaker Debugger Rules. https://docs.aws.amazon.com/sagemaker/latest/dg/use-debugger-built-in-rules.html
upvoted 1 times
...
...
Valcilio
1 year, 2 months ago
Selected Answer: B
It's B.
upvoted 1 times
...
AjoseO
1 year, 2 months ago
Selected Answer: B
AWS CloudTrail provides a history of AWS API calls made on the account. The Machine Learning team can use AWS CloudTrail to log Amazon SageMaker API calls to Amazon S3. They can then use CloudWatch to create alarms and receive notifications when the model is overfitting. To ensure auditors can view the Amazon SageMaker log activity report, the team can add code to push a custom metric to Amazon CloudWatch. This provides a single place to view and analyze logs across all the services and resources in the environment.
upvoted 1 times
...
sonalev419
2 years, 6 months ago
B. cloudwatch + metrics from sagemaker + sns https://docs.aws.amazon.com/fr_fr/sagemaker/latest/dg/training-metrics.html#define-train-metrics
upvoted 3 times
...
ybad
2 years, 6 months ago
B requires the least amount of code and satisfies all conditions
upvoted 2 times
...
tochiebby
2 years, 7 months ago
What does this line do? "Add code to push a custom metric to Amazon CloudWatch"
upvoted 1 times
Omar_Cascudo
2 years, 6 months ago
It creates a metric for overfitting (accuracy of training data and accuracy of test data).
upvoted 5 times
...
...
jonclem
2 years, 7 months ago
Its not B. Why would you use CloudTrail? Having used Lambda for API calls I'm inclined to agree with the original answer, C.
upvoted 1 times
Pja1
2 years, 7 months ago
https://docs.aws.amazon.com/sagemaker/latest/dg/logging-using-cloudtrail.html
upvoted 3 times
...
fhuadeen
2 years, 6 months ago
Because that is the only job of CloudTrail - to log actions taken on your AWS account. So why need a Lambda function to trigger it?
upvoted 3 times
...
...
Antriksh
2 years, 7 months ago
B it is
upvoted 2 times
...
C10ud9
2 years, 7 months ago
B it is
upvoted 1 times
...
lisiuyiu
2 years, 7 months ago
Agree on B
upvoted 2 times
...
ac427
2 years, 7 months ago
ALL AWS Service's API calls are logged to CloudTrail automatically.
upvoted 4 times
...

Get IT Certification

Unlock free, top-quality video courses on ExamTopics with a simple registration. Elevate your learning journey with our expertly curated content. Register now to access a diverse range of educational resources designed for your success. Start learning today with ExamTopics!

Start Learning for free
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

SaveCancel