Distillation loss — AI Dictionary

A training objective that blends a soft-target term against the teacher with a hard-label term against the ground truth.