Goodhart's Law — AI Dictionary

Once a proxy measure is used as an optimization target, agents learn to exploit it, and it stops tracking the thing it was meant to measure.