Symbol in context

$g_j$

This entry links every published equation using this exact notation. Its meaning may change between equations.

Used in 2 equations

d_i^{(m_2)} \approx \sum_{j=1}^{m_1} g_j\, d_j^{(m_1)}, \qquad \lVert g \rVert_0 \ll m_1, \quad m_1 < m_2,

The Hardest Unsolved Problems in Mechanistic Interpretability · Equation 5

This equation gives an approximation: it relates the quantities while allowing an approximation.

Equation guide → · This term → · Article →

\mathrm{RMSNorm}(x)_j = \frac{x_j}{\mathrm{RMS}(x)}\, g_j, \qquad \mathrm{RMS}(x) = \sqrt{\frac{1}{d}\sum_{k=1}^{d} x_k^2 + \epsilon}.

How Llama's Architecture Actually Works, Generation by Generation · Equation 19

This equation states an equality: the expressions on both sides have the same value under the article’s assumptions.

Equation guide → · This term → · Article →