Equation 37 · Part 1 · Shrink It, Train It Small, or Search for It: The Main Strategies for Small Models, Compared
Symbol C_search
What this part means
the architecture search pays.
Its job in the formula
earch is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol C_search→Article meaning
Where the article explains it
Architecture search pays , which can be enormous when paid fresh per target [ 7 ] or amortized across many targets when paid once as a supernet [ 10 ] , on top of whatever strategy trains the architecture it discovers.
The passage around this formula
…in the first place. Training small on purpose pays and in full, with no discount, in exchange for a model that inherits nothing it was not deliberately given. Architecture search pays , which can be enormous when paid fresh per target [ 7 ] or amortized across many targets when paid once as a supernet [ 10 ] , on top of whatever strategy trains the architecture it discovers. Sparse mixture-of-experts is the odd one out in this accounting: its saving shows up…
Learn the underlying idea
A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.
Open the illustrated subscripts: which member of a family? guide →
See this notation across published equations →
Sources cited in the surrounding passage
- [3] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning ↗
- [7] Neural Architecture Search with Reinforcement Learning ↗
- [10] Once for All: Train One Network and Specialize it for Efficient Deployment ↗
These citations provide research context; check each source for the exact claim it supports.