1. What is GPU GPU (Graphics Processing Unit) is chip designed to handle Graphics in computing environments. GPU is designed
Continue readingLearning Rate Schedules in Deep Learning
Learning rate schedules are techniques used to adjust Learning rate during training by predefined schedule. See what is Learning rate
Continue readingLearning Rate in Deep Learning
Learning rate is value by which weights are updated during Artificial neural network training. The value of Learning rate tell
Continue readingHow Birds are Superior than Humans in Sleeping
Birds are superior than humans in sleeping because they can sleep and fly but humans can’t sleep and walk or
Continue readingNesterov Momentum in Deep Learning
Nesterov momentum is different version of momentum update. It is also called Nesterov Accelerated Gradient. In practice it works better
Continue readingMomentum in Deep Learning
Momentum is Deep learning technique that is used along with Stochastic Gradient Descent. Instead of using only the gradient of the
Continue reading