AI Hardware & Semiconductors
Locality Is the Whole Game: The Memory Hierarchy and What a Kernel Does Not Read
Performance is decided by data movement, not arithmetic. The levels of the hierarchy, the locality that tiling manufactures, and the reason a fast kernel is fast because of what it never reads.