Masked Language Model
النموذج اللغوي المقنَّع
Definition
A training objective in which some tokens are hidden and the model is trained to predict them from the context in both directions.
Definition
A masked language model is trained to recover randomly masked tokens from bidirectional context, producing rich contextual representations as in BERT.
