Cache repeated model work without serving stale answers
Caching is valuable when many requests share the same instructions, reference material, or deterministic transformation. It becomes dangerous when the answer depends on user state, rapidly changing data, permissions, or time-sensitive fa...
