Module 05 of 12

Gradients & the Chain Rule

Lessons

About This Module

Real models have many settings, not just one. A partial derivative measures how the error changes when you nudge a single setting, and collecting all of them into one vector gives the gradient, which points in the direction where the error rises fastest. Going the opposite way is how a model improves.

The lessons start with partial derivatives and gradients, then introduce the chain rule, the tool for finding derivatives of functions built from other functions. That is exactly how a neural network is built, which makes the chain rule the heart of backpropagation. They finish with how frameworks like PyTorch apply it automatically through automatic differentiation.

Watch the lessons in order, then continue on to Optimization.

Lessons

6 videos
01

Best Explanation of Partial Derivatives and Gradients

An explanation of partial derivatives and the gradient, the starting point for how models with many settings learn.

Video 5min
02

Partial Derivatives and Gradient Descent: The Engine Driving ML

Links partial derivatives to gradient descent, the method that drives learning in machine learning models.

Video 34min
03

Chain Rule Explained: The Math Behind Backpropagation & Deep Learning

Explains the chain rule and how it underlies backpropagation in deep learning.

Video 5min
04

Understanding Backpropagation In Neural Networks with Basic Calculus

Shows how backpropagation in neural networks works using basic calculus.

Video 24min
05

PyTorch Explained: Computation Graph and Backpropagation, torch.autograd, backward, grad

Shows how PyTorch builds a computation graph and uses torch.autograd to run backpropagation automatically.

Video 10min