← All parts of this equation

Equation 22 · Part 8 · How a Model Actually Gets Small Enough to Run on a Phone

=

xq=clip(⌊xs⌉+z, qmin⁡, qmax⁡),x^=s(xq−z)x_q = \mathrm{clip}\left(\left\lfloor \frac{x}{s} \right\rceil + z,\ q_{\min},\ q_{\max}\right), \qquad \hat{x} = s\left(x_q - z\right)
=

What this part means

The expressions on both sides represent the same quantity under the stated assumptions.

Its job in the formula

The equals sign connects the complete expression on the left with the complete expression on the right. Both sides must have compatible units.

The passage around this formula

The standard affine mapping takes a real value x , a scale s and a zero-point z , and produces an integer xq=clip(⌊xs⌉+z, qmin⁡, qmax⁡),x^=s(xq−z)x_q = \mathrm{clip}\left(\left\lfloor \frac{x}{s} \right\rceil + z,\ q_{\min},\ q_{\max}\right), \qquad \hat{x} = s\left(x_q - z\right). where ⌊\lfloor ⋅\cdot ⌉\rceil is round-to-nearest and x^\hat{x} is the dequantised approximation actually used in arithmetic. Jacob and colleagues’ integer-arithmetic scheme, still the reference formulation for this mapping, showed that with weights and activations quantized this way, “inference can be carried out using integer-only arithmetic” end to end on ordinary integer hardware, with no floating-point unit required at all, which is what makes the technique valuable on the cheapest edge silicon rather than merely on the largest [ 7 ] .

Read this part in the article →

Learn the underlying idea

An equals sign says that the expression on its left and the expression on its right have the same value under the stated definitions and assumptions.

Open the illustrated equality: what the equals sign claims guide →

Sources cited in the surrounding passage

These citations provide research context; check each source for the exact claim it supports.