Category
2 articles in this category.
Written by me.
Distillation trades a large teacher for a smaller student. Read how it works, a worked plan, and why the teacher is not a free label machine.
PEFT trains a small fraction of parameters. Read the LoRA mechanism, a worked resource comparison, and when full fine-tuning still wins.