Question

Which method is used for reducing the learning rate during the training of neural networks to avoid overshooting the optimal weights?

a) Gradient Descent

b) Learning Rate Decay

c) Momentum

d) Batch Normalization

Answer 1

b) Learning Rate Decay