following the slope of a loss surface to its floor
Plate VIII
Step0
Loss—
Rate η0.0020
RuleVanilla
The surface is Rosenbrock’s valley, $f=(1-x)^2+5(y-x^2)^2$. Each step moves
against the gradient; the curved floor forces the classic zig-zag.
After A. Cauchy · method of steepest descent, 1847