LoRA and FT Are Unnecessary: How to Approach Distilled Models

Introduction Fine-tuning (FT) a distilled model is either ineffective or leads to...