ExamTopics Logo
Mail Us[email protected]
Menu
Google Discussions
exam questions

Exam Professional Machine Learning Engineer All Questions

View all questions & answers for the Professional Machine Learning Engineer exam
Go to Exam

Exam Professional Machine Learning Engineer topic 1 question 159 discussion

Actual exam question from Google's Professional Machine Learning Engineer
Question #: 159
Topic #: 1
[All Professional Machine Learning Engineer Questions]

Your organization manages an online message board. A few months ago, you discovered an increase in toxic language and bullying on the message board. You deployed an automated text classifier that flags certain comments as toxic or harmful. Now some users are reporting that benign comments referencing their religion are being misclassified as abusive. Upon further inspection, you find that your classifier's false positive rate is higher for comments that reference certain underrepresented religious groups. Your team has a limited budget and is already overextended. What should you do?

  • A. Add synthetic training data where those phrases are used in non-toxic ways.
  • B. Remove the model and replace it with human moderation.
  • C. Replace your model with a different text classifier.
  • D. Raise the threshold for comments to be considered toxic or harmful.
Show Suggested Answer Hide Answer
Suggested Answer: A 🗳️
by PST21 at July 20, 2023, 4:10 p.m.

Comments

Chosen Answer:
This is a voting comment (?). It is better to Upvote an existing comment if you don't have anything to add.
Switch to a voting comment New
Submit Cancel
NamitSehgal
5 months, 2 weeks ago
Selected Answer: A
By adding synthetic training data that includes benign references to the underrepresented religious groups, you can help the model better understand the context in which these phrases are used and reduce the false positive rate. T
upvoted 2 times
...
vini123
5 months, 4 weeks ago
Selected Answer: A
Option A actively teaches the model to differentiate toxic from non-toxic uses of religious references, reducing bias while maintaining strong moderation.
upvoted 2 times
...
Omi_04040
7 months, 3 weeks ago
Selected Answer: A
Main issue is to address the bias in the model
upvoted 1 times
...
Laur_C
7 months, 3 weeks ago
Selected Answer: A
I chose A - least expensive/time consuming way to actually solve the problem. D sacrifices model quality and does not change the inherent bias of the model, meaning that the biases would still remain if this solution was chosen. Does not seem like the ethical/best practices solution
upvoted 2 times
...
rajshiv
8 months ago
Selected Answer: A
D is not a good answer. Raising the threshold would reduce the number of toxic comments flagged (perhaps lowering false positives), but it would also increase the number of actual toxic comments being missed (higher false negatives). This exacerbates the problem and do not address the bias in the model. I think A is the best answer.
upvoted 2 times
...
f084277
8 months, 3 weeks ago
Selected Answer: D
The answer is D. Of course A would be ideal, but it totally ignores the constraints presented in the question that your team is already overextended.
upvoted 4 times
...
Dirtie_Sinkie
10 months, 3 weeks ago
Selected Answer: A
Gonna go with A on this one. Some toxic comments will still make it through if you choose D, whereas A addresses the problem fully and directly. Therefore I think A is a more complete answer than D.
upvoted 1 times
Dirtie_Sinkie
10 months, 3 weeks ago
Even though in the question it says "Your team has a limited budget and is already overextended" I still think A is the better answer because it doesn't take much effort to create synthetic data and add it to train. The outcome will be more accurate than D.
upvoted 2 times
f084277
8 months, 3 weeks ago
Of course A is "better", but it ignores the constraints of the question and is therefore wrong.
upvoted 1 times
...
...
...
baimus
10 months, 4 weeks ago
Selected Answer: A
A is better than D, because D means that more geniunely toxic comments will make it through. A will teach the model to acknowledge the small subset of mislabelled comments, without exposing the customers to additional toxicity.
upvoted 1 times
...
AzureDP900
1 year, 1 month ago
option A (Add synthetic training data where those phrases are used in non-toxic ways) directly addresses the specific issue of bias and improves the model's accuracy by providing more contextually relevant training examples. This approach is more targeted and has a lower risk of introducing new biases or negatively impacting other aspects of comment moderation. I hope this additional explanation helps clarify why option D might not be the best choice in this scenario!
upvoted 2 times
AzureDP900
1 year, 1 month ago
Raising the threshold would mean increasing the minimum score required for a comment to be classified as toxic or harmful. This could potentially reduce the number of false positives (benign comments being misclassified as toxic) by making it harder for the model to classify a comment as toxic.
upvoted 1 times
...
...
Simple_shreedhar
1 year, 2 months ago
A option directly addresses the bias issue without incurring significant ongoing costs or burdening the moderation team. By augmenting the training dataset with synthetic examples where phrases related to underrepresented religious groups are used in non-toxic ways, the classifier can learn to distinguish between toxic and benign comments more accurately.
upvoted 2 times
...
gscharly
1 year, 3 months ago
Selected Answer: D
agree with daidai75
upvoted 1 times
...
pinimichele01
1 year, 3 months ago
Selected Answer: D
Your team has a limited budget and is already overextended
upvoted 2 times
...
7cb0ab3
1 year, 3 months ago
Selected Answer: A
I went fo A because it directly tackels the issue of misclassification and improving the models unterstanding of religious references. B and C don't make sense. D would generally reduce the number of comments flagged as toxic, which could decrease the false positive rate. However, this approach risks allowing genuinely harmful comments to go unflagged. It addresses the symptom (high false positive rate) rather than the underlying cause
upvoted 2 times
...
edoo
1 year, 5 months ago
Selected Answer: A
B and C are non sense, I don't want to risk potentially increasing the FNR by reducing the FPR (Raise the threshold). Thus A.
upvoted 1 times
...
daidai75
1 year, 6 months ago
Selected Answer: D
Your team has a limited budget and is already overextended, that means the re-training is hardly possible.
upvoted 2 times
...
tavva_prudhvi
2 years ago
In the long run, usually we go with A, but Option D could be a temporary solution to reduce false positives, while being aware that it may allow some genuinely toxic comments to go unnoticed. However, this may be a necessary trade-off until your team has the resources to improve the classifier or find a better solution.
upvoted 1 times
...
powerby35
2 years ago
Selected Answer: D
"Your team has a limited budget and is already overextended"
upvoted 2 times
...
Load full discussion...
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

SaveCancel