Transformer Architecture — AI Dictionary

The neural network design built around an attention mechanism, where every position in the input can weigh and draw on every other position, underlying nearly all current large language models.