Layer Normalization

تطبيع الطبقة

Abbreviation: LN

Definition

Normalization that computes the mean and variance over the features of a single example, not over the batch, which suits sequences.

Definition

Layer normalisation normalises activations across the features of each individual example, independent of batch size, and is standard in transformers.

Learn and review

Suggested terms to learn next