Equation 15 · Part 1 · AI Datacenter Systems Engineering in Practice: An Advanced Technical Guide
Symbol C
What this part means
C is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Its job in the formula
C is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol C→Article meaning
The passage around this formula
…GPU pause time” while “increasing checkpoint frequency to reduce the amount of lost work after a recovery” [ 2 ] . Check-N-Run, Meta’s earlier checkpointing system built for large recommendation models, attacks the same C term directly through two techniques — differential checkpointing that tracks and saves only the portion of the model that changed, and quantization of the saved values — reporting a 6-to-17x reduction in required write bandwidth and a 2.5-to-8x reduction in required storage capacity on…
Learn the underlying idea
A variable is a named place for a value. Its letter is a local label: x can mean position in one formula and a data point in another.
Open the illustrated variables: a letter stands for a value guide →
See this notation across published equations →
Sources cited in the surrounding passage
- [2] The Llama 3 Herd of Models ↗
- [5] Check-N-Run: A Checkpointing System for Training Deep Learning Recommendation Models ↗
- [4] Characterization of Large Language Model Development in the Datacenter ↗
These citations provide research context; check each source for the exact claim it supports.