Symbol in context

$\hat a$

This entry links every published equation using this exact notation. Its meaning may change between equations.

Used in 2 equations

\hat a

How Mechanistic Interpretability Research Is Actually Done · Equation 8

This mathematical expression combines the displayed quantities; its precise role follows from the surrounding article text.

Equation guide → · This term → · Article →

\mathcal{L}_{\mathrm{SAE}}(a) = \lVert a - \hat a \rVert_2^2 + \lambda \lVert z \rVert_1, \qquad \hat a = W_{\mathrm{dec}}\, z + b_{\mathrm{dec}}, \qquad z = \mathrm{ReLU}\!\left(W_{\mathrm{enc}}(a - b_{\mathrm{dec}}) + b_{\mathrm{enc}}\right).

How Mechanistic Interpretability Research Is Actually Done · Equation 9

This equation states an equality: the expressions on both sides have the same value under the article’s assumptions.

Equation guide → · This term → · Article →