Your LLM Context Window Is Lying to You: How Token Budgets Actually Work

The context window number in your model's docs is a capacity spec, not a promise. A model that advertises 200K tokens will happily accept 200K tokens, but the quality of what it does with them starts ...