Probability & Statistics
Uncertainty made rigorous — probability distributions, maximum likelihood, Bayesian reasoning, and statistical inference for ML practitioners.
8 lessons
01Thinking in Probabilities
Sample spaces, events, random variables, and expectation — the vocabulary everything else in this course is written in.
Probability Distributions
Random variables, expectation, variance, and the key distributions that appear everywhere in machine learning.
Maximum Likelihood Estimation
How to fit distributions to data — MLE, log-likelihood, and the connection between cross-entropy loss and Gaussian negative log-likelihood.
Bayesian Inference
Incorporating prior knowledge into learning — Bayes' theorem, posteriors, conjugate priors, and MAP estimation.
Entropy & KL Divergence
Measuring surprise, comparing distributions, and why cross-entropy is the loss function of deep learning.
Statistical Inference & Confidence Intervals
From a sample to a claim about the world — sampling distributions, the standard error, the Central Limit Theorem, and confidence intervals that quantify how sure you can be.
Hypothesis Testing & p-values
Deciding whether an effect is real — null and alternative hypotheses, the z-test and t-test, p-values and significance, and the two ways a test can be wrong.
Probability & Statistics Quiz
Test your understanding of distributions, MLE, Bayesian inference, statistical inference, and hypothesis testing.