Symbol N
N is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Read this term in its guide →Published equation contexts
Why this formula appears here
Take a dense model with N parameters served at p bytes per parameter. The weight traffic per decoding step is Np , incurred once per step regardless of how many requests share it. The per-request cache traffic is
Read the representative guide
Symbol p
p is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Read this term in its guide →How to interpret it
Read this expression with the definitions, units, and assumptions supplied by the article.
Published contexts (1)
A symbol can carry a different meaning in another article. Each occurrence keeps its own guide and term definitions.
Equation 3 · Foundation Models
The Physical Economics of Inference: Bandwidth, Energy, and the Limits of a Datacenter
This mathematical expression combines the displayed quantities; its precise role follows from the surrounding article text.
Take a dense model with N parameters served at p bytes per parameter. The weight traffic per decoding step is Np , incurred once per step regardless of how many requests share it. The per-request cache traffic is
Equation guide → · Article →