← All parts of this equation

Equation 12 · Part 1 · How AI Memory Systems and the Bandwidth Wall Actually Work

Symbol M_KV

MKV  =  2 n h d e b l,M_{\mathrm{KV}} \;=\; 2 \, n \, h \, d \, e \, b \, l ,
MKVM_{\mathrm{KV}}

What this part means

MKM_KV is part of the quantity the equation computes from the expression on the right.

Its job in the formula

MKM_KV is part of the quantity the equation computes from the expression on the right.

The passage around this formula

…9 ] . That single equation is the whole mechanism: nothing about it is a design choice an inference engineer can simply decline. Extend the conversation, and l grows; serve more requests at once, and b grows; either way MKVM_{\mathrm{KV}} grows with it, and Hooper and colleagues note that at sufficiently long context lengths the KV cache — not the model’s weights — becomes the dominant consumer of memory during inference [ 9 ] .

Read this part in the article →

Learn the underlying idea

A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.

Open the illustrated subscripts: which member of a family? guide →

See this notation across published equations →

Sources cited in the surrounding passage

These citations provide research context; check each source for the exact claim it supports.