← All parts of this equation

Equation 33 · Part 1 · How a Model Actually Gets Small Enough to Run on a Phone

Symbol x

max⁡(∣x∣)\max(|x|)
xx

What this part means

x is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.

Its job in the formula

x is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.

The passage around this formula

The formula above needs one number, max⁡(∣x∣)\max(|x|) , and the choice of what “one” applies to matters more than it looks. A single scale for an entire weight tensor is per-tensor quantization: cheap to store, one number per layer, but forced to size itself to whichever single row or output channel happens to have the largest values, wasting resolution on every other channel that has a smaller range.

Read this part in the article →

Learn the underlying idea

A function assigns an output to each allowed input. The expression f(x) means “apply f to x”.

Open the illustrated functions: inputs become outputs guide →

See this notation across published equations →

Sources cited in the article section

These citations provide research context; check each source for the exact claim it supports.