intermediate

GPU Programming for ML

Why GPUs power modern machine learning — the SIMT execution model, the CUDA programming model, the memory optimizations that decide real performance, how deep-learning kernels map onto the hardware, and how training scales across many GPUs.

GPU ArchitectureSIMTWarps & ThreadsCUDA Programming ModelMemory HierarchyMemory CoalescingShared Memory & TilingOccupancyRoofline ModelGEMM & Tensor CoresMixed PrecisionKernel FusionData & Model ParallelismZeRO / FSDPPipeline Parallelism
ML project loop1/6 stages →
DataHypothesis spaceObjectiveOptimizationEvaluationDeployment feedback