Positional encoding — AI Dictionary

Expanding a raw coordinate into many sine and cosine frequencies before it reaches a network's layers, so the network can represent fine detail.