In machine learning and statistics, the learning rate is a tuning parameter in an optimization algorithm that determines the step size at each iteration while moving toward a minimum of a loss function.
A core concept in optimization.
One of the most important hyperparameters to tune in deep learning.