Data wall — AI Dictionary

The point at which the supply of high-quality, not-yet-trained-on text runs out, capping how far pretraining data can scale.