Skip to content

Kit · Glossary · AI systems

Context window budget

Treating the model's input limit as a budget to spend on the most useful content, because more context can lower quality and always raises cost.

You have done this if

You trimmed retrieved chunks to the best five and summarised long conversation history.

Say it in a review

We budget the context: instructions, the top five passages and a rolling summary, not everything we have.