intermediate

Optimization for ML

How models actually learn — gradient descent variants, convexity theory, and constrained optimization.

SGD vs Full-Batch GDMomentumRMSpropAdamBias CorrectionConvexityJensen's InequalityLagrange MultipliersKKT ConditionsDualityLoss FunctionsHyperparameter OptimizationHyperband & AutoML
ML project loop2/6 stages →
DataHypothesis spaceObjectiveOptimizationEvaluationDeployment feedback