Equation 4 · Part 1 · How AI Inference Serving Actually Works
Symbol I
What this part means
the ratio of arithmetic performed to bytes moved.
Its job in the formula
I is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol I→Article meaning
Where the article explains it
Which one binds a given piece of work depends on that work’s arithmetic intensity — the ratio of arithmetic performed to bytes moved: I = A computation is compute-bound when I exceeds the hardware’s own ratio of FLOPs to bandwidth, and memory-bound when it falls below it.
The passage around this formula
A computation is compute-bound when I exceeds the hardware’s own ratio of FLOPs to bandwidth, and memory-bound when it falls below it. Prefill, processing every position of a prompt against the same weight matrices in one pass, reuses each loaded weight across many tokens at once, so its arithmetic intensity is high and it sits on…
Learn the underlying idea
A variable is a named place for a value. Its letter is a local label: x can mean position in one formula and a data point in another.
Open the illustrated variables: a letter stands for a value guide →
See this notation across published equations →
Sources cited in the surrounding passage
These citations provide research context; check each source for the exact claim it supports.