← All parts of this equation

Equation 13 · Part 8 · Comparing the Main Approaches to AI Memory Systems and the Bandwidth Wall

subscript

Mkv  ≈  2 L H dh b T,M_{\mathrm{kv}} \;\approx\; 2 \, L \, H \, d_h \, b \, T,
subscript

What this part means

The lower label selects a particular version, component, or indexed member of the quantity. For example, x₀ and xₜ can be values at different positions.

Its job in the formula

A subscript distinguishes a version, component, step, or member of a quantity. It does not automatically mean multiplication.

The passage around this formula

None of the four sections above describes a system anyone ships in isolation. A contemporary AI accelerator composes several of these answers on top of each other, for a reason the earlier article in this series already established: capacity and bandwidth are separate constraints with separate symptoms, and a real workload — serving a large language model’s key-value cache is the canonical case — hits both at once. The KV cache for a single sequence grows as Mkv  ≈  2 L H dh b TM_{\mathrm{kv}} \;\approx\; 2 \, L \, H \, d_h \, b \, T. with L layers, H key/value heads, dhd_h head dimension, b bytes per stored element and T tokens of context — a quantity that scales linearly with context length and batch size, and has to be both stored somewhere and…

Read this part in the article →

Learn the underlying idea

A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.

Open the illustrated subscripts: which member of a family? guide →

Sources cited in the surrounding passage

These citations provide research context; check each source for the exact claim it supports.