Temperature

درجة الحرارة (في التوليد)

Definition

A parameter that controls the randomness of a language model's generation: low values make it decisive, high values make it more varied.

Definition

Temperature is a sampling parameter that rescales logits before softmax in language model decoding: low values make outputs more deterministic and high values more diverse.

Mathematical equations

p_i=\frac{\exp(z_i/T)}{\sum_j\exp(z_j/T)}

Learn and review

Suggested terms to learn next