Temperature
درجة الحرارة (في التوليد)
Definition
A parameter that controls the randomness of a language model's generation: low values make it decisive, high values make it more varied.
Definition
Temperature is a sampling parameter that rescales logits before softmax in language model decoding: low values make outputs more deterministic and high values more diverse.
Mathematical equations
p_i=\frac{\exp(z_i/T)}{\sum_j\exp(z_j/T)}