Equation 20 · Probing, Sparse Autoencoders, Patching, and Steering: The Main Interpretability Methods, Compared
What does this equation mean?
Read the formula alongside the article passage below. Each part has a deeper page with its role in the equation, the supporting passage and nearby citations.
This mathematical expression combines the displayed quantities; its precise role follows from the surrounding article text. Read the equation part by part below; each part has a contextual explanation and a link to its mathematical background.
Read it piece by piece
Symbol m_patch
that same metric after the activations of component set are copied from one run into the other.
subscript
The lower label selects a particular version, component, or indexed member of the quantity. For example, x₀ and xₜ can be values at different positions.
How to interpret it
Read this expression with the definitions, units, and assumptions supplied by the article.
What the article says around this equation
where and are a chosen behavioural metric measured on the clean and corrupted runs, and is that same metric after the activations of component set are copied from one run into the other. A score near one means patching alone restores nearly all of the clean behaviour; a score near zero means it restores almost none.
Sources cited in the article section
- [9] Causal Mediation Analysis for Interpreting Neural NLP: The Case of Gender Bias ↗
- [10] Locating and Editing Factual Associations in GPT ↗
- [11] How to Use and Interpret Activation Patching ↗
These citations give research context. Read each source to check which claims it supports.