Equation 33 · Part 3 · Shrink It, Train It Small, or Search for It: The Main Strategies for Small Models, Compared

Symbol C_curate

C_{\text{lifetime}} = \underbrace{C_{\text{reuse}}}_{\text{compress}} \;+\; \underbrace{C_{\text{curate}} + C_{\text{train}}}_{\text{train small}} \;+\; \underbrace{C_{\text{search}}}_{\text{NAS}} \;+\; Q \cdot \bar c_{\text{tok}}, \qquad \text{with} \quad M_{\text{resident}} \le B_{\text{mem}}

C_{\text{curate}}

What this part means

the training small on purpose pays.

Its job in the formula

$C_c$ urate is one of the signed contributions combined to compute the quantity on the left.

Full expressionSymbol C_curateArticle meaning

Where the article explains it

Training small on purpose pays $C_{\text{curate}}$ and $C_{\text{train}}$ in full, with no discount, in exchange for a model that inherits nothing it was not deliberately given.

The passage around this formula

…Compression pays mostly $C_{\text{reuse}}$ , a documented small fraction of a from-scratch training cost [ 3 ] , but only if a suitable large model is available to reuse in the first place. Training small on purpose pays $C_{\text{curate}}$ and $C_{\text{train}}$ in full, with no discount, in exchange for a model that inherits nothing it was not deliberately given. Architecture search pays $C_{\text{search}}$ , which can be enormous when paid fresh per target [ 7 ] or amortized across many targets when paid once as a…

Read this part in the article →

Learn the underlying idea

A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.

Open the illustrated subscripts: which member of a family? guide →

See this notation across published equations →

Sources cited in the surrounding passage

These citations provide research context; check each source for the exact claim it supports.