Symbol k
k is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Read this term in its guide →Published equation contexts
Why this formula appears here
The two axes are related but not reducible to one another, and the coupling has an economic root worth making explicit. Autoregressive decoding is bounded by how much has to be read from memory to produce each token — the weights, plus whatever context has accumulated — and Pope and colleagues formalized exactly this partitioning of cost between arithmetic and memory movement in transformer serving [ 5 ] . Write n for the number of tokens a system must hold in an answer’s working set. Pasting a whole corpus of size M into context puts a floor under n near M itself; retrieving costs roughly the price of an index lookup plus the price of reasoning over the k M tokens actually returned:
Read the representative guide
How to interpret it
Read this expression with the definitions, units, and assumptions supplied by the article.
Research cited beside this formula
Published contexts (1)
A symbol can carry a different meaning in another article. Each occurrence keeps its own guide and term definitions.
Equation 5 · AI Agents & Systems
RAG in 2035: Four Scenarios, Their Signals, and What Would Falsify Them
This mathematical expression combines the displayed quantities; its precise role follows from the surrounding article text.
The two axes are related but not reducible to one another, and the coupling has an economic root worth making explicit. Autoregressive decoding is bounded by how much has to be read from memory to produce each token — the weights, plus whatever context has accumulated — and Pope and colleagues formalized exactly this partitioning of cost between arithmetic and memory movement in transformer serving [ 5 ] . Write n for the number of tokens a system must hold in an answer’s working set. Pasting a whole corpus of size M into context puts a floor under n near M itself; retrieving costs roughly the price of an index lookup plus the price of reasoning over the k M tokens actually returned: