Every token you spend on retrieved text is a token you cannot spend on instructions. Here is how I split it, and what happened when I got the ratio wrong.
Explainer10 min read
Treat the context window as a budget, not a bucket
Every token you spend on retrieved text is a token you cannot spend on instructions. Here is how I split it, and what happened when I got the ratio wrong.
AI systemsRetrieval
Source links stay with the relevant section