Gradient Descent and its Variants in Deep Learning

1. Gradient Descent Gradient descent is an optimization algorithm used for finding weights (parameters) in Deep learning that will produce