Exam AI-102 topic 7 question 3 discussion

Given answers are correct

I would have picked Top P and Temperature as well.. but the recommendation is to configure one and leave the other as default value.

Temperature is CORRECT because it controls the randomness of the model's responses. Lowering the temperature makes the responses more deterministic and less creative by reducing the likelihood of generating different variations. Top P is CORRECT because it determines the nucleus sampling for the responses. Lowering the Top P value limits the model to consider only the top probability choices, making the responses more deterministic.

answer are correct

was on exam 20.06.24

temperature controls the "creativity" of the generated text, between 0 and 2. A higher temperature will result in more diverse and unexpected responses, while a lower temperature will result in more conservative and predictable responses. The default value for temperature is 1.0, but you can experiment with different values to see what works best for your use case. Higher values means the model will take more risks. Try 0.9 for more creative applications, and 0 (argmax sampling) for ones with a well-defined answer. We generally recommend altering this or top_p but not both. top_p - An alternative to sampling with temperature, called nucleus sampling, where the model considers the results of the tokens with top_p probability mass. 1 is the default value. So 0.1 means only the tokens comprising the top 10% probability mass are considered. We generally recommend altering this or temperature but not both.

1. Temperature 2. Top P

Temperature Top P

To make the responses more deterministic and less creative, it is recommended to lower the values of Temperature and TopP.