Gradient descent
Minimizing a cost function by iteratively computing the gradient and moving in the direction of steepest descent.
- from
- Naming
- added
- 2026-10-10
- likes
- 0
similar
-
Gradient Descent wandb.ai
-
Gradient descent algorithms in a saddle point sebastianruder.com
Visualize how different optimizers interacts with a saddle points.
-
Gradient descent algorithms in an almost flat landscape devblogs.nvidia.com
Visualize how different optimizers interacts with an almost flat landscape.
-
Learning to learn by gradient descent by gradient descent arxiv.org
RNN as an optimizer: introducing the L2L optimizer, a meta-neural network.
-
L0 Gradient Optimization cse.cuhk.edu.hk
-
Hill climbing en.wikipedia.org
Starting somewhere in the hilly "landscape" of solutions, you go in the direction of steepest ascent until reaching the top of a hill. You might miss higher hills, though.
Naming › Machine Learning and Artificial Intelligence: “Minimizing a cost function by iteratively computing the gradient and moving in the direction of steepest descent.”