ExamTopics Logo
Mail Us[email protected]
Menu
Databricks Discussions
exam questions

Exam Certified Generative AI Engineer Associate All Questions

View all questions & answers for the Certified Generative AI Engineer Associate exam
Go to Exam

Exam Certified Generative AI Engineer Associate topic 1 question 62 discussion

Actual exam question from Databricks's Certified Generative AI Engineer Associate
Question #: 62
Topic #: 1
[All Certified Generative AI Engineer Associate Questions]

A Generative AI Engineer has built an LLM-based system that will automatically translate user text between two languages. They now want to benchmark multiple LLM’s on this task and pick the best one. They have an evaluation set with known high quality translation examples. They want to evaluate each LLM using the evaluation set with a performant metric.

Which metric should they choose for this evaluation?

  • A. BLEU metric
  • B. NDCG metric
  • C. ROUGE metric
  • D. RECALL metric
Show Suggested Answer Hide Answer
Suggested Answer: A 🗳️
by DavidMiller at May 4, 2025, 1:47 p.m.

Comments

Chosen Answer:
This is a voting comment (?). It is better to Upvote an existing comment if you don't have anything to add.
Switch to a voting comment New
Submit Cancel
DavidMiller
1 month, 2 weeks ago
Selected Answer: A
in the name really, Bilingual Evaluation Understudy (BLEU)
upvoted 1 times
...
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

SaveCancel