advanced

Fine-Tuning & Alignment

Adapt foundation models to your domain and align them with human preferences — SFT, parameter-efficient fine-tuning (LoRA/QLoRA), reward models, RLHF, DPO, and quantization.

Supervised Fine-TuningInstruction TuningPEFTLoRAQLoRAReward ModelsRLHFDPOModel MergingQuantizationKnowledge Distillation
ML project loop5/6 stages →
DataHypothesis spaceObjectiveOptimizationEvaluationDeployment feedback