Discriminative Fine-Tuning: Why Your Backbone and Your Head Shouldn't Learn at the Same Speed

I was recently fine-tuning DEIMv2 — a DETR-style detector with a DINOv3 Vision Transformer backbone — starting from a COCO-pretrained checkpoint, to build a single-class face detector. While wiring up...