Sparse autoencoder — AI Dictionary

A smaller network trained on a model's activations that re-expresses them as a larger, mostly-inactive set of features.