Learning rate schedules are techniques used to adjust Learning rate during training by predefined schedule. See what is Learning rate
Continue readingCategory: Artificial Intelligence
Learning Rate in Deep Learning
Learning rate is value by which weights are updated during Artificial neural network training. The value of Learning rate tell
Continue readingNesterov Momentum in Deep Learning
Nesterov momentum is different version of momentum update. It is also called Nesterov Accelerated Gradient. In practice it works better
Continue readingMomentum in Deep Learning
Momentum is Deep learning technique that is used along with Stochastic Gradient Descent. Instead of using only the gradient of the
Continue reading