Equation 18 · Part 1 · Dense, Sparse, and Distilled: Comparing Approaches to Frontier Model Capacity
Symbol M
What this part means
M is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Its job in the formula
M is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol M→Article meaning
The passage around this formula
Distillation attacks M directly. Hinton, Vinyals, and Dean set out the mechanism: train a small student to match the full output distribution of a large teacher rather than the hard labels, on the grounds that the teacher’s relative probabilities over incorrect classes carry information the labels do not [ 6 ] . The student learns a smoothed, information-rich target that is easier to fit than the raw task.
Learn the underlying idea
A variable is a named place for a value. Its letter is a local label: x can mean position in one formula and a data point in another.
Open the illustrated variables: a letter stands for a value guide →
See this notation across published equations →
Sources cited in the surrounding passage
These citations provide research context; check each source for the exact claim it supports.