Explainer · · 2 min read
Chunk for the question, not for the token limit
Chunk size is a decision about what a complete answer looks like. Reranking, context budgets and refusal thresholds finish the job.
Topic
In the glossary: Context window budget, Retrieval-augmented generation (RAG), what each means and how to say it in a review
Explainer · · 2 min read
Chunk size is a decision about what a complete answer looks like. Reranking, context budgets and refusal thresholds finish the job.
Explainer · · 2 min read
How chunk boundaries decide what evidence the system can actually retrieve.