Gradient Descent in Practice 2: Learning Rate
How to adjust the learning rate of a neural network.
- from
- Education
- added
- 2026-10-10
- likes
- 0
similar
-
Gradient Descent youtube.com
Okay, I already listed Andrew NG's Coursera class above, but this video especially is quite pertinent as an introduction and defines the gradient descent algorithm.
-
-
Learning to learn by gradient descent by gradient descent arxiv.org
RNN as an optimizer: introducing the L2L optimizer, a meta-neural network.
-
Estimating an Optimal Learning Rate For a Deep Neural Network medium.com
Clever trick to estimate an optimal learning rate prior any single full training.
-
Deep Learning Lecture 12: Recurrent Neural Nets and LSTMs youtube.com
Unfolding of RNN graphs is explained properly, and potential problems about gradient descent algorithms are exposed.
-
Gradient Descent wandb.ai
Education › Other Math Theory > Gradient Descent Algorithms & Optimization Theory: “How to adjust the learning rate of a neural network.”