Visualizing Optimizer Dynamics on a Loss Surface
i
Loss Function:
Marker Size (px):
Animation Speed:
Slow
Normal
Fast
Surface Type:
--
Global Minimum
Local Minimum
Elliptical Bowl
Saddle Point
Hills
Plateau
Weight Range:
Bias Range:
Optimizer:
Gradient Descent
Momentum
Adagrad
RMSprop
Adam
Learning Rate:
Momentum (β):
Decay Rate (γ):
Beta1 (β₁):
Beta2 (β₂):
Plot
Start
Pause
Reset
Please pause to perform those operations.