NLP LLMs Intermediate

Language Model

النموذج اللغوي

Abbreviation: LM

Definition

A model that estimates the probability of a sequence of words or predicts the next word given the preceding ones.

Definition

A language model assigns probabilities to sequences of tokens, typically by predicting the next token given the preceding context.

Mathematical equations

p(x_1,\dots,x_T)=\prod_{t=1}^{T}p(x_t\mid x_1,\dots,x_{t-1})

Learn and review

Suggested terms to learn next