Dark knowledge — AI Dictionary

The information hidden in a teacher model's relative confidence across wrong answers, invisible in a single hard label.