← All parts of this equation

Equation 5 · Part 6 · The Hardest Unsolved Problems in Mechanistic Interpretability

Symbol g

di(m2)≈∑j=1m1gj dj(m1),∥g∥0≪m1,m1<m2,d_i^{(m_2)} \approx \sum_{j=1}^{m_1} g_j\, d_j^{(m_1)}, \qquad \lVert g \rVert_0 \ll m_1, \quad m_1 < m_2,
gg

What this part means

g is an input to the expression that computes the quantity on the left.

Its job in the formula

g is an input to the expression that computes the quantity on the left.

The passage around this formula

…Writing di(m2)d_i^{(m_2)} for one feature direction recovered by a dictionary of size m2m_2 and dj(m1)d_j^{(m_1)} for the directions recovered by a smaller dictionary of size m1m_1 , their finding is that di(m2)≈∑j=1m1gj dj(m1),∥g∥0≪m1,m1<m2d_i^{(m_2)} \approx \sum_{j=1}^{m_1} g_j\, d_j^{(m_1)}, \qquad \lVert g \rVert_0 \ll m_1, \quad m_1 < m_2. with g itself sparse. A direction that a large dictionary presents as one unit is recoverable as a sparse combination of a smaller dictionary’s units, which means the large dictionary’s “atoms” are not atomic. Put the incompleteness and the non-atomicity results together and no dictionary size is…

Read this part in the article →

Learn the underlying idea

A variable is a named place for a value. Its letter is a local label: x can mean position in one formula and a data point in another.

Open the illustrated variables: a letter stands for a value guide →

See this notation across published equations →

Sources cited in the surrounding passage

These citations provide research context; check each source for the exact claim it supports.