Scaling Laws

قوانين التحجيم

Definition

Empirical relationships showing that model loss decreases regularly (as a power law) as parameters, data and compute increase.

Definition

Scaling laws are empirical power-law relationships showing predictable decreases in loss as model size, data and compute increase.

Learn and review

Suggested terms to learn next