Start here
Calculus & Gradients, in plain language
Understand slopes, partial derivatives, the chain rule, and gradient descent through visual and coded experiments. Gradients connect a model error to parameter updates and make optimization behavior explainable rather than magical.
For a small example, minimize (w - 3)^2 starting at w = 0. Differentiate to get 2(w - 3), take a small step opposite the gradient, and watch the loss shrink. This is the mechanism to keep in view as the lesson becomes more technical. Before moving on, identify the input, transformation, output, and one observation that would falsify your conclusion.
Key points
- Functions, slopes, derivatives, and local linear approximation.
- Partial derivatives, gradients, directional derivatives, and chain rule.
- Loss surfaces, learning rate, steps, and stopping criteria.