Equation 6 · Part 5 · What an AI Accelerator Actually Is: Silicon, Packaging, and the Memory It Can Reach
Symbol s
What this part means
bytes occupied by each element.
Its job in the formula
s occurs below the fraction bar. The quantity above the bar is divided by this expression; zero is excluded as a denominator.
Full expression→Symbol s→Article meaning
Where the article explains it
If each element occupies s bytes, the ratio of work done to bytes moved is .
The passage around this formula
Multiplying an m k matrix by a k n matrix performs 2mnk floating-point operations while touching mk + kn + mn elements. If each element occupies s bytes, the ratio of work done to bytes moved is . which for large square matrices grows in proportion to the dimension. Double the matrix size and you roughly double the work performed per byte fetched. Almost nothing else in general-purpose computing behaves this way, and it is the entire economic basis for building a machine around one operation.
Learn the underlying idea
A variable is a named place for a value. Its letter is a local label: x can mean position in one formula and a data point in another.
Open the illustrated variables: a letter stands for a value guide →
See this notation across published equations →
Sources cited in the article section
- [1] In-Datacenter Performance Analysis of a Tensor Processing Unit ↗
- [3] TPU v4: An Optically Reconfigurable Supercomputer for Machine Learning with Hardware Support for Embeddings ↗
- [10] NVIDIA Hopper Tuning Guide ↗
These citations provide research context; check each source for the exact claim it supports.