Symbol w_eff
ff is part of the quantity the equation computes from the expression on the right.
Read this term in its guide →Published equation contexts
Fact. The move from FP8 to sub-8-bit formats has already happened once, and the mechanism by which it happened exposes the trade-off that will decide whether it happens again. A microscaling format with element width w bits, block size k , and a shared scale of s bits carries an effective per-element cost of . with the second term the amortised metadata tax. The OCP MX alliance’s MXFP4 uses w = 4 , k = 32 , and an 8-bit shared scale, for = 4.25 bits per element — a roughly 6% tax [ 4 ] . NVIDIA’s NVFP4 instead uses a smaller block, k = 16 , with the same 8-bit block scale plus a near-negligible per-tensor term, for 4.5 bits per…
ff is part of the quantity the equation computes from the expression on the right.
Read this term in its guide →w is part of the quantity the equation computes from the expression on the right.
Read this term in its guide →s occurs above the fraction bar. The numerator is divided by the entire denominator below it.
Read this term in its guide →With a fixed numerator, increasing a nonzero denominator reduces the fraction. Read it with the definitions, units, and assumptions supplied by the article.
A symbol can carry a different meaning in another article. Each occurrence keeps its own guide and term definitions.
Equation 9 · Semiconductors
This equation states an equality: the expressions on both sides have the same value under the article’s assumptions.
Fact. The move from FP8 to sub-8-bit formats has already happened once, and the mechanism by which it happened exposes the trade-off that will decide whether it happens again. A microscaling format with element width w bits, block size k , and a shared scale of s bits carries an effective per-element cost of . with the second term the amortised metadata tax. The OCP MX alliance’s MXFP4 uses w = 4 , k = 32 , and an 8-bit shared scale, for = 4.25 bits per element — a roughly 6% tax [ 4 ] . NVIDIA’s NVFP4 instead uses a smaller block, k = 16 , with the same 8-bit block scale plus a near-negligible per-tensor term, for 4.5 bits per…