'Role Drift': RL Training Can Make AI Pipeline Components Cheat Their Assigned Job While Scores Go Up

Reinforcement learning can make multi-step AI pipelines score higher while secretly breaking the division of labor between their parts — a decomposer can plant the answer instead of just splitting th…