=

The passage around this formula

with $P_{\max}$ the peak arithmetic rate of the device, B the achievable bandwidth of the memory tier supplying the operands, and P the attainable performance [ 11 ] . The two terms cross at a ridge point $I^{*}$ = $P_{\max}$/B : below it, runtime is set by how many bytes must move, whatever the peak arithmetic rate promises; above it, the arithmetic units are the limit and the memory system is idle capacity. Because peak compute has grown roughly twice as fast as memory bandwidth for two decades running [ 12 ] , that ridge point has been climbing — a kernel that was comfortably compute-bound on one generation of hardware can become memory-bound on the next without a single line of its code…

Read this part in the article →