Beginner

Optimizer

المحسن

Definition

A specific implementation of the gradient descent algorithm. Popular optimizers include: • AdaGrad, which stands for ADAptive GRADient. • Adam, which stands for ADAptive with Momentum.

Learn and review