Equation 33 · Part 4 · Shrink It, Train It Small, or Search for It: The Main Strategies for Small Models, Compared
Symbol C_train
What this part means
rain is one of the signed contributions combined to compute the quantity on the left.
Its job in the formula
rain is one of the signed contributions combined to compute the quantity on the left.
Full expression→Symbol C_train→Article meaning
The passage around this formula
… , a documented small fraction of a from-scratch training cost [ 3 ] , but only if a suitable large model is available to reuse in the first place. Training small on purpose pays and in full, with no discount, in exchange for a model that inherits nothing it was not deliberately given. Architecture search pays , which can be enormous when paid fresh per target [ 7 ] or amortized across many targets when paid once as a supernet [ 10 ] , on top…
Learn the underlying idea
A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.
Open the illustrated subscripts: which member of a family? guide →
See this notation across published equations →
Sources cited in the surrounding passage
- [3] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning ↗
- [7] Neural Architecture Search with Reinforcement Learning ↗
- [10] Once for All: Train One Network and Specialize it for Efficient Deployment ↗
These citations provide research context; check each source for the exact claim it supports.