← All symbols

Symbol in context

ϵ\epsilon

This entry links every published equation using this exact notation. Its meaning may change between equations.

Meanings in context

Used in 20 equations

RMSNorm(x)j=xjRMS(x) gj,RMS(x)=1d∑k=1dxk2+ϵ.\mathrm{RMSNorm}(x)_j = \frac{x_j}{\mathrm{RMS}(x)}\, g_j, \qquad \mathrm{RMS}(x) = \sqrt{\frac{1}{d}\sum_{k=1}^{d} x_k^2 + \epsilon}.

How Llama's Architecture Actually Works, Generation by Generation · Equation 19

This equation states an equality: the expressions on both sides have the same value under the article’s assumptions.

Equation guide → · This term → · Article →
Ldiffusion=Ex0, ϵ∼N(0,I), t[ ∥ϵ−ϵθ(xt,t,c)∥2 ],xt=αˉt x0+1−αˉt ϵ\mathcal{L}_{\text{diffusion}} = \mathbb{E}_{x_0,\, \epsilon \sim \mathcal{N}(0, I),\, t} \Big[\, \big\| \epsilon - \epsilon_\theta(x_t, t, c) \big\|^2 \,\Big], \qquad x_t = \sqrt{\bar{\alpha}_t}\, x_0 + \sqrt{1 - \bar{\alpha}_t}\, \epsilon

Adapters, Native Pretraining, and Unified Tokens: The Main Multimodal Architectures, Compared · Equation 12

This equation states an equality: the expressions on both sides have the same value under the article’s assumptions.

Equation guide → · This term → · Article →