Next-token prediction — AI Dictionary

The model's only operation: given a sequence of tokens, produce a probability distribution over the next one, sample, append, repeat.