Tag: Nesterov Momentum with SGD

Nesterov momentum is different version of momentum update. It is also called Nesterov Accelerated Gradient. In practice it works better

Continue reading