BERT

بيرت

Abbreviation: BERT

Definition

A bidirectional encoder language model based on the Transformer, pre-trained by masking words and predicting them.

Definition

BERT is a bidirectional transformer encoder pre-trained with masked language modelling and next-sentence prediction, then fine-tuned for downstream tasks.

Learn and review

Suggested terms to learn next