Model Distillation — AI Dictionary

Training a smaller, cheaper model to reproduce the behavior of a larger, more expensive one, so the smaller model captures much of the bigger model's capability without needing the bigger model's com…