Masked Language Model

النموذج اللغوي المقنَّع

Abbreviation: MLM

Definition

A training objective in which some tokens are hidden and the model is trained to predict them from the context in both directions.

Definition

A masked language model is trained to recover randomly masked tokens from bidirectional context, producing rich contextual representations as in BERT.

Learn and review

Suggested terms to learn next