Equation 26 · Part 3 · How a Model Actually Gets Small Enough to Run on a Phone
Symbol b
What this part means
b occurs below the fraction bar. The quantity above the bar is divided by this expression; zero is excluded as a denominator.
Its job in the formula
b occurs below the fraction bar. The quantity above the bar is divided by this expression; zero is excluded as a denominator.
Full expression→Symbol b→Article meaning
The passage around this formula
For weights, a common simplification is symmetric quantization around zero, with z=0 and the scale set directly by the largest magnitude present: . for a signed integer of b bits. An 8-bit integer has 2^8=256 representable levels; a 4-bit integer has 2^4=16 . That sixteen-fold reduction in available codes is the entire cost of quantization in one number. Treating the rounding error as approximately uniform over one quantization step s , its expected squared magnitude is the classical result
Learn the underlying idea
A variable is a named place for a value. Its letter is a local label: x can mean position in one formula and a data point in another.
Open the illustrated variables: a letter stands for a value guide →
See this notation across published equations →
Sources cited in the article section
These citations provide research context; check each source for the exact claim it supports.