Equation 14 · Part 1 · How a Model Actually Gets Small Enough to Run on a Phone
Symbol w_ij
What this part means
j is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Its job in the formula
j is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol w_ij→Article meaning
The passage around this formula
Distillation decides how the student’s weights are trained. Pruning decides which weights exist afterward. The oldest and simplest criterion is magnitude: rank every weight by || and remove the smallest fraction, on the reasoning that a weight close to zero contributes almost nothing to the layer’s output no matter what it is multiplied against. Applied once, magnitude pruning at any aggressive ratio breaks the network; applied iteratively, alternating a pruning step with a retraining step that lets the surviving weights absorb what the removed ones were doing, it can remove a large majority of parameters with only a small accuracy cost.
Learn the underlying idea
A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.
Open the illustrated subscripts: which member of a family? guide →
See this notation across published equations →
Sources cited in the article section
These citations provide research context; check each source for the exact claim it supports.