Equation 7 · Part 1 · How Do We Know a Compressed Model Still Works?
Symbol w_i
What this part means
is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Its job in the formula
is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol w_i→Article meaning
The passage around this formula
where is accuracy, or another per-task quality measure, on task i , and is that task’s share of the total, with the weights summing to one. The arithmetic makes the trap explicit: S can be almost unchanged by compression even when some single collapses, provided for that task is small relative to the rest, or provided a rise elsewhere offsets the fall. A single published number, ninety-eight point six percent of baseline, or a small perplexity increase, cannot by construction distinguish “compression cost nothing” from “compression cost a great deal on one task nobody weighted heavily.” Both produce the same S .
Learn the underlying idea
A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.
Open the illustrated subscripts: which member of a family? guide →
See this notation across published equations →
The article lists its research sources here.