Equation 18 · Part 1 · AI Memory Systems and the Bandwidth Wall in 2035: Scenarios, Signals, and Falsifiable Predictions
Symbol S
What this part means
the streamingllm instead shrinks effective.
Its job in the formula
S is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol S→Article meaning
Where the article explains it
StreamingLLM instead shrinks effective S : it keeps only a small window of recent tokens plus a handful of initial “attention sink” tokens, and reports enabling stable generation over sequences up to four million tokens with up to a 22.2-times speedup over recomputing a sliding window from scratch [ 14 ] .
The passage around this formula
…to the company’s own prior 67-billion-parameter dense model, while extending supported context to 128,000 tokens [ 15 ] . That shrinks the per-token cost of the equation above. StreamingLLM instead shrinks effective S : it keeps only a small window of recent tokens plus a handful of initial “attention sink” tokens, and reports enabling stable generation over sequences up to four million tokens with up to a 22.2-times speedup over recomputing a sliding window from scratch [ 14 ] . H2O shrinks S adaptively…
Learn the underlying idea
A variable is a named place for a value. Its letter is a local label: x can mean position in one formula and a data point in another.
Open the illustrated variables: a letter stands for a value guide →
See this notation across published equations →
Sources cited in the surrounding passage
- [15] DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model ↗
- [14] Efficient Streaming Language Models with Attention Sinks ↗
- [16] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models ↗
These citations provide research context; check each source for the exact claim it supports.