Exam Certified Generative AI Engineer Associate topic 1 question 14 discussion

Actual exam question from Databricks's Certified Generative AI Engineer Associate

Question #: 14
Topic #: 1

[All Certified Generative AI Engineer Associate Questions]

A Generative Al Engineer is creating an LLM system that will retrieve news articles from the year 1918 and related to a user's query and summarize them. The engineer has noticed that the summaries are generated well but often also include an explanation of how the summary was generated, which is undesirable.
Which change could the Generative Al Engineer perform to mitigate this issue?

A. Split the LLM output by newline characters to truncate away the summarization explanation.
B. Tune the chunk size of news articles or experiment with different embedding models.
C. Revisit their document ingestion logic, ensuring that the news articles are being ingested properly.
D. Provide few shot examples of desired output format to the system and/or user prompt.

Show Suggested Answer

Suggested Answer: D 🗳️

by Soumak at Dec. 28, 2024, 1:06 p.m.

Comments

Submit Cancel

seaun

1 week, 6 days ago

Selected Answer: D

This technique involves providing the LLM with a few example input-output pairs to guide its behavior and demonstrate the desired format. By showing the model how you want the output to look (e.g., just the summary without any explanation), you significantly increase the chances that it will adhere to that format in subsequent responses.

upvoted 2 times

...

Duke_CT

2 weeks ago

Selected Answer: B

I would go with B. Anyone else?

upvoted 1 times

...