Beginner

Model parallelism

توازي النموذج

Definition

A way of scaling training or inference that puts different parts of one model on different devices. Model parallelism enables models that are too big to fit on a single device. See also data parallelism.

Learn and review