Marko Kovacevic Blog – Sharing knowledge, amazing things and ideas

Batch Normalization

Normalization Before we learn about Batch normalization lets see what is Normalization. It is technique of transforming the data to

Adaptive learning rate algorithms monitor the performance of the training and based on monitoring they adjust learning rate. They provide

What is Regularization Regularization is a technique that helps reduce overfitting or reduce variance in Neural network by penalizing for complexity.

Bias Bias is error of Machine learning model. It is inability for a Machine learning algorithm to capture true relationship.

Loss function The Loss function computes the error for a single training example. Cost function The Cost function is the

Deep Learning is better then other Traditional Machine learning algorithms because it gives better precision when it use large amount

1. Gradient Descent Gradient descent is an optimization algorithm used for finding weights (parameters) in Deep learning that will produce

1. What is Tensor Tensors are primary data structures used by Artificial Neural Networks. All inputs and outputs are represented

1. What is GPU GPU (Graphics Processing Unit) is chip designed to handle Graphics in computing environments. GPU is designed

Learning rate schedules are techniques used to adjust Learning rate during training by predefined schedule. See what is Learning rate