Sparse activation — AI Dictionary

Running only a small subset of one model's own parameters per input, the mechanism behind MoE.