Equation 28 · Part 1 · Shrink It, Train It Small, or Search for It: The Main Strategies for Small Models, Compared
Symbol E
What this part means
E is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Its job in the formula
E is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol E→Article meaning
The passage around this formula
Shazeer and colleagues stated the underlying argument for conditional computation directly: “a trainable gating network determines a sparse combination of experts to use for each example,” a mechanism they showed could scale model capacity by “over 1000x” while keeping the compute spent on any one example roughly constant [ 11 ] . The now-standard form of a sparse mixture-of-experts layer routes each token to a small top- k subset of E available experts:
Learn the underlying idea
A variable is a named place for a value. Its letter is a local label: x can mean position in one formula and a data point in another.
Open the illustrated variables: a letter stands for a value guide →
See this notation across published equations →
Sources cited in the surrounding passage
These citations provide research context; check each source for the exact claim it supports.