Equation 16 · Part 1 · AI Memory Systems and the Bandwidth Wall in 2035: Scenarios, Signals, and Falsifiable Predictions
Symbol H_kv
What this part means
v is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Its job in the formula
v is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol H_kv→Article meaning
The passage around this formula
bytes, the leading factor of two accounting for keys and values together. That equation is worth writing out because it exposes the one real lever every mitigation below actually pulls: none of them escapes linear growth in S and B . Each instead shrinks one of the other factors — most consequentially , the number of key-value heads actually stored.
Learn the underlying idea
A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.
Open the illustrated subscripts: which member of a family? guide →
See this notation across published equations →
Sources cited in the article section
- [15] DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model ↗
- [14] Efficient Streaming Language Models with Attention Sinks ↗
- [16] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models ↗
These citations provide research context; check each source for the exact claim it supports.