Token budgets are a product-design decision
A token limit affects more than API cost. It determines how much history the system keeps, whether evidence survives into the answer, how much room remains for tool results, and when a conversation needs summarization or compaction.
All...
