addition

The passage around this formula

The physical limitation keeping analog in-memory compute confined to inference on weights that rarely change is the flip side of its core trick: a conductance that can be read out to represent a weight can also drift over time, and writing a new one wears the device in a way reading does not, so retraining costs more, in time and device lifetime, than in a design where weights sit in ordinary digital memory. A simple accounting for why raw operations-per-watt numbers are not directly comparable across any of the four approaches in this piece is worth writing out once: $E_{\text{op}} = E_{\text{core}} + E_{\text{periphery}} + E_{\text{I/O}}$. where $E_{\text{core}}$ is the energy of the operation itself — the multiply-accumulate, the interference…

Read this part in the article →