Symbol C
C is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Read this term in its guide →Published equation contexts
Why this formula appears here
What this buys, mechanically, is a denser training signal per example. A hard label carries C bits at most, for C classes, and in practice far less once you account for how skewed real label distributions are. A full teacher distribution over the same classes carries a graded judgment about every one of them, on every training example, for free. That is why a student trained this way can match a network many times its size on the same data budget: it is not learning faster, it is being taught with a richer curriculum. The modern survey literature on this technique describes it as the backbone of an entire ecosystem for building small open models from large proprietary ones, with the…
Read the representative guide
How to interpret it
Read this expression with the definitions, units, and assumptions supplied by the article.
Research cited beside this formula
Published contexts (1)
A symbol can carry a different meaning in another article. Each occurrence keeps its own guide and term definitions.
Equation 12 · Edge AI & Electronics
How a Model Actually Gets Small Enough to Run on a Phone
This mathematical expression combines the displayed quantities; its precise role follows from the surrounding article text.
What this buys, mechanically, is a denser training signal per example. A hard label carries C bits at most, for C classes, and in practice far less once you account for how skewed real label distributions are. A full teacher distribution over the same classes carries a graded judgment about every one of them, on every training example, for free. That is why a student trained this way can match a network many times its size on the same data budget: it is not learning faster, it is being taught with a richer curriculum. The modern survey literature on this technique describes it as the backbone of an entire ecosystem for building small open models from large proprietary ones, with the…
Equation guide → · Article →