Equation 15 · Part 1 · AI Memory Systems and the Bandwidth Wall in 2035: Scenarios, Signals, and Falsifiable Predictions
Symbol B
What this part means
the batch size.
Its job in the formula
B is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol B→Article meaning
Where the article explains it
For a model with L layers, key-value heads, head dimension , sequence length S , batch size B , and p bytes stored per element, the cache occupies approximately = 2 \, L \, \, \, S \, B \, p bytes, the leading factor of two accounting for keys and values together.
The passage around this formula
bytes, the leading factor of two accounting for keys and values together. That equation is worth writing out because it exposes the one real lever every mitigation below actually pulls: none of them escapes linear growth in S and B . Each instead shrinks one of the other factors — most consequentially , the number of key-value heads actually stored.
Learn the underlying idea
A variable is a named place for a value. Its letter is a local label: x can mean position in one formula and a data point in another.
Open the illustrated variables: a letter stands for a value guide →
See this notation across published equations →
Sources cited in the article section
- [15] DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model ↗
- [14] Efficient Streaming Language Models with Attention Sinks ↗
- [16] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models ↗
These citations provide research context; check each source for the exact claim it supports.