Attention — AI Dictionary

A mechanism that lets each token look at every other token and weigh how relevant it is.