Mixture of Experts — AI Dictionary

Mixture of Experts — a model built from many specialized sub-networks plus a router that picks which ones run.