← All symbols

Symbol in context

Ldistill\mathcal{L}_{\text{distill}}

This entry links every published equation using this exact notation. Its meaning may change between equations.

Used in 1 equation

Ldistill=(1−α) CE(y, σ(zs))  +  α T2 CE(σ(zt/T), σ(zs/T))\mathcal{L}_{\text{distill}} = (1-\alpha)\,\mathrm{CE}\big(y,\ \sigma(z_s)\big) \;+\; \alpha\, T^2\,\mathrm{CE}\big(\sigma(z_t/T),\ \sigma(z_s/T)\big)

Shrink It, Train It Small, or Search for It: The Main Strategies for Small Models, Compared · Equation 1

This equation states an equality: the expressions on both sides have the same value under the article’s assumptions.

Equation guide → · This term → · Article →