ExamTopics Logo
Mail Us[email protected]
Menu
Databricks Discussions
exam questions

Exam Certified Generative AI Engineer Associate All Questions

View all questions & answers for the Certified Generative AI Engineer Associate exam
Go to Exam

Exam Certified Generative AI Engineer Associate topic 1 question 67 discussion

Actual exam question from Databricks's Certified Generative AI Engineer Associate
Question #: 67
Topic #: 1
[All Certified Generative AI Engineer Associate Questions]

A Generative AI Engineer has just deployed an LLM application at a manufacturing company that assists with answering customer service inquiries. They need to identity the key enterprise metrics to monitor the application in production.

Which is NOT a metric they will implement for their customer service LLM application in production?

  • A. Massive Multi-task Language Understanding (MMLU) score
  • B. Number of customer inquiries processed per unit of time
  • C. Factual accuracy of the response
  • D. Time taken for LLM to generate a response
Show Suggested Answer Hide Answer
Suggested Answer: A 🗳️
by DavidMiller at May 3, 2025, 11:32 a.m.

Comments

Chosen Answer:
This is a voting comment (?). It is better to Upvote an existing comment if you don't have anything to add.
Switch to a voting comment New
Submit Cancel
DavidMiller
3 months ago
Selected Answer: A
MMLU is a benchmarking score used during LLM pre-training and evaluation, not something you’d monitor in a deployed, real-world production setting.
upvoted 3 times
...
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

SaveCancel