← All parts of this equation

Equation 14 · Part 2 · How a Model Actually Gets Small Enough to Run on a Phone

subscript

∣wij∣|w_{ij}|
subscript

What this part means

The lower label selects a particular version, component, or indexed member of the quantity. For example, x₀ and xₜ can be values at different positions.

Its job in the formula

A subscript distinguishes a version, component, step, or member of a quantity. It does not automatically mean multiplication.

The passage around this formula

Distillation decides how the student’s weights are trained. Pruning decides which weights exist afterward. The oldest and simplest criterion is magnitude: rank every weight by |wijw_{ij}| and remove the smallest fraction, on the reasoning that a weight close to zero contributes almost nothing to the layer’s output no matter what it is multiplied against. Applied once, magnitude pruning at any aggressive ratio breaks the network; applied iteratively, alternating a pruning step with a retraining step that lets the surviving weights absorb what the removed ones were doing, it can remove a large majority of parameters with only a small accuracy cost.

Read this part in the article →

Learn the underlying idea

A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.

Open the illustrated subscripts: which member of a family? guide →

Sources cited in the article section

These citations provide research context; check each source for the exact claim it supports.