Exam AWS Certified AI Practitioner AIF-C01 topic 1 question 223 discussion

Exam question from Amazon's AWS Certified AI Practitioner AIF-C01

Question #: 223
Topic #: 1

[All AWS Certified AI Practitioner AIF-C01 Questions]

A company has set up a translation tool to help its customer service team handle issues from customers around the world. The company wants to evaluate the performance of the translation tool. The company sets up a parallel data process that compares the responses from the tool to responses from actual humans. Both sets of responses are generated on the same set of documents.

Which strategy should the company use to evaluate the translation tool?

A. Use the Bilingual Evaluation Understudy (BLEU) score to estimate the absolute translation quality of the two methods.
B. Use the Bilingual Evaluation Understudy (BLEU) score to estimate the relative translation quality of the two methods.
C. Use the BERTScore to estimate the absolute translation quality of the two methods.
D. Use the BERTScore to estimate the relative translation quality of the two methods.

Show Suggested Answer

Suggested Answer: B 🗳️

by nand2804 at Aug. 4, 2025, 6:28 p.m.

Disclaimers:

- ExamTopics website is not related to, affiliated with, endorsed or authorized by Amazon.
- Trademarks, certification & product names are used for reference only and belong to Amazon.

Comments

Submit Cancel

nand2804

2 weeks, 2 days ago

Selected Answer: B

The BLEU score (Bilingual Evaluation Understudy) is a widely used automatic metric for evaluating the quality of machine translation output by comparing it to human reference translations. BLEU is best suited for comparing relative performance between two or more translation methods (e.g., human vs. machine). It evaluates n-gram overlap between machine-generated and human-generated text. While it does not capture meaning deeply (like semantic similarity), it is commonly used due to its simplicity and effectiveness for benchmarking.

upvoted 1 times

...