Layer Normalization
تطبيع الطبقة
Definition
Normalization that computes the mean and variance over the features of a single example, not over the batch, which suits sequences.
Definition
Layer normalisation normalises activations across the features of each individual example, independent of batch size, and is standard in transformers.
