LoRA Doesn't Approximate Fine-Tuning. It Changes What You Can Teach

TL;DR— Low-rank adapters are treated as a cheaper stand-in for full-parameter fine-tuning, but the rank bottleneck reshapes the optimization landscape itself. For preference optimization and distillat...