Layer normalization — AI Dictionary

A rescaling step that keeps the numbers flowing through a deep stack of layers well-behaved.