Equation 17 · Part 9 · Probing, Sparse Autoencoders, Patching, and Steering: The Main Interpretability Methods, Compared
Numerator: m_patch(mathcal C) - m_corrupt
What this part means
The complete quantity above the fraction bar.
Its job in the formula
atch(mathcal C) - orrupt occurs above the fraction bar. The numerator is divided by the entire denominator below it.
Full expression→Numerator: m_patch(mathcal C) - m_corrupt→Article meaning
The passage around this formula
The general operation, activation patching, is usually reported as a normalised score rather than a raw difference, isolating exactly how much of the gap between clean and corrupted behaviour a given component set closes: . where and are a chosen behavioural metric measured on the clean and corrupted runs, and is that same metric after the activations of component set are copied from one run into the other. A score near one means patching alone restores nearly all of the clean behaviour; a score near zero means it restores almost none.
Learn the underlying idea
A fraction a/b means a divided by b. The top number is the numerator; the bottom number is the denominator, and it cannot be zero.
Open the illustrated fractions: division written vertically guide →
Sources cited in the article section
- [9] Causal Mediation Analysis for Interpreting Neural NLP: The Case of Gender Bias ↗
- [10] Locating and Editing Factual Associations in GPT ↗
- [11] How to Use and Interpret Activation Patching ↗
These citations provide research context; check each source for the exact claim it supports.