← All symbols

Symbol in context

LKD\mathcal{L}_{\mathrm{KD}}

This entry links every published equation using this exact notation. Its meaning may change between equations.

Used in 1 equation

LKD=α LCE(y,σ(zs))+(1−α) T2 KL(σ(zt/T) ∥ σ(zs/T))\mathcal{L}_{\mathrm{KD}} = \alpha \, \mathcal{L}_{\mathrm{CE}}\left(y, \sigma(z_s)\right) + (1-\alpha)\, T^2 \, \mathrm{KL}\left(\sigma(z_t / T) \,\Vert\, \sigma(z_s / T)\right)

How a Model Actually Gets Small Enough to Run on a Phone · Equation 7

This equation states an equality: the expressions on both sides have the same value under the article’s assumptions.

Equation guide → · This term → · Article →