Equation 9 · Part 1 · The Physical Economics of Inference: Bandwidth, Energy, and the Limits of a Datacenter
Symbol b
What this part means
b is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Its job in the formula
b is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol b→Article meaning
The passage around this formula
First, the weight term is fixed and the cache term is not, so there is a batch size below which you are paying full weight traffic for very little output — the reason low-traffic deployments of large models are so unfavourable per token. Second, because the cache term scales with both b and s , long contexts and high concurrency compete directly for the same budget. You may have one or the other and not both, which is a physical statement rather than a pricing policy.
Learn the underlying idea
A variable is a named place for a value. Its letter is a local label: x can mean position in one formula and a data point in another.
Open the illustrated variables: a letter stands for a value guide →
See this notation across published equations →
The article lists its research sources here.