Equation 11 · The Hidden Infrastructure Bill Behind Every RAG Answer
What does this equation mean?
Read the formula alongside the article passage below. Each part has a deeper page with its role in the equation, the supporting passage and nearby citations.
This mathematical expression combines the displayed quantities; its precise role follows from the surrounding article text. Read the equation part by part below; each part has a contextual explanation and a link to its mathematical background.
Read it piece by piece
Symbol C_RAG
AG is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
subscript
The lower label selects a particular version, component, or indexed member of the quantity. For example, x₀ and xₜ can be values at different positions.
How to interpret it
Read this expression with the definitions, units, and assumptions supplied by the article.
What the article says around this equation
Filling in the billion-chunk illustration used throughout: at a hundred thousand queries a month, comes to roughly 2,195 dollars of storage plus about 11,500 dollars of combined query and rerank cost, or approximately 13,700 dollars a month, not counting the one-time ingestion charge. If the same workload instead pasted 100,000 tokens of context into every call to substitute for what retrieval would have selected, at OpenAI’s gpt-5.6-sol long-context input rate of ten dollars per million tokens, comes to one dollar per query, or 100,000 dollars a month — about seven times the retrieval pipeline’s bill. This is arithmetic on a stated hypothetical workload, not…
Read the full surrounding passage
Filling in the billion-chunk illustration used throughout: at a hundred thousand queries a month, comes to roughly 2,195 dollars of storage plus about 11,500 dollars of combined query and rerank cost, or approximately 13,700 dollars a month, not counting the one-time ingestion charge. If the same workload instead pasted 100,000 tokens of context into every call to substitute for what retrieval would have selected, at OpenAI’s gpt-5.6-sol long-context input rate of ten dollars per million tokens, comes to one dollar per query, or 100,000 dollars a month — about seven times the retrieval pipeline’s bill. This is arithmetic on a stated hypothetical workload, not a measurement of either approach in production, and it depends entirely on the size of E , the amount of context a given task would actually need without retrieval; a task where the relevant evidence is small, or where the corpus fits comfortably inside the window, tilts the comparison the other way.
Sources cited in the article section
- [1] API Pricing ↗
- [11] Gemini Developer API Pricing ↗
- [10] Retrieval Augmented Generation or Long-Context LLMs? A Comprehensive Study and Hybrid Approach ↗
These citations give research context. Read each source to check which claims it supports.
Return to The Hidden Infrastructure Bill Behind Every RAG Answer