Stochastic Gradient Descent – Marko Kovacevic Blog

Gradient Descent and its Variants in Deep Learning

1. Gradient Descent Gradient descent is an optimization algorithm used for finding weights (parameters) in Deep learning that will produce