← All symbols

Symbol in context

aa

This entry links every published equation using this exact notation. Its meaning may change between equations.

Meanings in context

Used in 72 equations

a∗=arg⁡min⁡a∈A Lval(w∗(a), a)subject tog(a)≤B,w∗(a)=arg⁡min⁡w Ltrain(w,a)a^* = \arg\min_{a \in \mathcal{A}} \ \mathcal{L}_{\text{val}}\big(w^*(a),\, a\big) \quad \text{subject to} \quad g(a) \le B, \qquad w^*(a) = \arg\min_{w} \ \mathcal{L}_{\text{train}}(w, a)

Shrink It, Train It Small, or Search for It: The Main Strategies for Small Models, Compared · Equation 19

This equation states a bound: one expression must stay on the indicated side of the other under the article’s assumptions.

Equation guide → · This term → · Article →
LSAE(a)=∥a−a^∥22+λ∥z∥1,a^=Wdec z+bdec,z=ReLU ⁣(Wenc(a−bdec)+benc).\mathcal{L}_{\mathrm{SAE}}(a) = \lVert a - \hat a \rVert_2^2 + \lambda \lVert z \rVert_1, \qquad \hat a = W_{\mathrm{dec}}\, z + b_{\mathrm{dec}}, \qquad z = \mathrm{ReLU}\!\left(W_{\mathrm{enc}}(a - b_{\mathrm{dec}}) + b_{\mathrm{enc}}\right).

How Mechanistic Interpretability Research Is Actually Done · Equation 9

This equation states an equality: the expressions on both sides have the same value under the article’s assumptions.

Equation guide → · This term → · Article →