dogear

enter for all results · esc to close

Gradient descent algorithms in a saddle point

sebastianruder.comsite

Visualize how different optimizers interacts with a saddle points.

from
Education
added
2026-10-10
likes
0

similar

  1. Gradient descent algorithms in an almost flat landscape devblogs.nvidia.com

    Visualize how different optimizers interacts with an almost flat landscape.

  2. Gradient descent en.wikipedia.org

    Minimizing a cost function by iteratively computing the gradient and moving in the direction of steepest descent.

  3. Gradient Descent wandb.ai
  4. L0 Gradient Optimization cse.cuhk.edu.hk
  5. Learning to learn by gradient descent by gradient descent arxiv.org

    RNN as an optimizer: introducing the L2L optimizer, a meta-neural network.

  6. Beyond stochastic gradient descent for large-scale machine learning videolectures.net

Education › Other Math Theory > Gradient Descent Algorithms & Optimization Theory: “Visualize how different optimizers interacts with a saddle points.”