Prompt Caching — AI Dictionary

Prompt caching stores the processed version of a prompt's stable, repeated portion — like a system prompt or reference document — so a later request can reuse it instead of the model reprocessing tha…