Symbol B
B is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Read this term in its guide →Published equation contexts
Why this formula appears here
read in full every step for every active request. Total bytes moved per step across a batch of b requests at sequence length s is therefore approximately . and the achievable step rate is B divided into the device’s usable bandwidth. Two things follow immediately.
Read the representative guide
Symbol b
b is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Read this term in its guide →Symbol N
N is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Read this term in its guide →Symbol p
p is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Read this term in its guide →Symbol M_kv
v is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Read this term in its guide →How to interpret it
Its accuracy depends on the assumptions and range of use described in the article.
Published contexts (1)
A symbol can carry a different meaning in another article. Each occurrence keeps its own guide and term definitions.
Equation 7 · Foundation Models
The Physical Economics of Inference: Bandwidth, Energy, and the Limits of a Datacenter
This equation gives an approximation: it relates the quantities while allowing an approximation.
read in full every step for every active request. Total bytes moved per step across a batch of b requests at sequence length s is therefore approximately . and the achievable step rate is B divided into the device’s usable bandwidth. Two things follow immediately.