← All parts of this equation

Equation 8 · Part 2 · AI Memory Systems and the Bandwidth Wall in Practice: An Advanced Technical Guide

subscript

MKVM_{\mathrm{KV}}
subscript

What this part means

The lower label selects a particular version, component, or indexed member of the quantity. For example, x₀ and xₜ can be values at different positions.

Its job in the formula

A subscript distinguishes a version, component, step, or member of a quantity. It does not automatically mean multiplication.

The passage around this formula

Paging attacks the allocator, not the product. Kwon and colleagues observed that existing serving systems store each request’s KV cache in one contiguous span of memory sized for its maximum possible length, and that this produces internal fragmentation, external fragmentation, and duplicated memory across parallel sampling requests — the paper reports that existing systems waste 60 to 80 percent of KV cache memory this way. Their PagedAttention design instead manages the cache in fixed-size blocks addressed indirectly, the same idea an operating system uses for virtual memory, and reports near-zero waste in KV cache memory alongside a 2 to 4 times improvement in serving throughput at the…

Read this part in the article →

Learn the underlying idea

A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.

Open the illustrated subscripts: which member of a family? guide →

Sources cited in the surrounding passage

These citations provide research context; check each source for the exact claim it supports.