Subgoal hardening — AI Dictionary

A self-generated stepping-stone that was meant to serve the goal instead gets optimized as if it were the goal.