Published equation contexts
Why this formula appears here
Matrix multiplication is the canonical demonstration because it has enormous latent reuse and a naive schedule that throws almost all of it away. Multiplying two N N matrices performs about 2 operations on 3 words — an intensity proportional to N , which for large N is spectacularly compute-bound in principle. Executed as three nested loops in the obvious order, though, each element of one input is re-read from main memory on every pass, and the realised intensity collapses toward a small constant. The available reuse and the exploited reuse are different quantities, and only the second appears in the roofline.
Read the representative guide
How to interpret it
Read this expression with the definitions, units, and assumptions supplied by the article.
Published contexts (1)
A symbol can carry a different meaning in another article. Each occurrence keeps its own guide and term definitions.
Equation 12 · AI Hardware & Semiconductors
Locality Is the Whole Game: The Memory Hierarchy and What a Kernel Does Not Read
This mathematical expression combines the displayed quantities; its precise role follows from the surrounding article text.
Matrix multiplication is the canonical demonstration because it has enormous latent reuse and a naive schedule that throws almost all of it away. Multiplying two N N matrices performs about 2 operations on 3 words — an intensity proportional to N , which for large N is spectacularly compute-bound in principle. Executed as three nested loops in the obvious order, though, each element of one input is re-read from main memory on every pass, and the realised intensity collapses toward a small constant. The available reuse and the exploited reuse are different quantities, and only the second appears in the roofline.