Equation 5 · Part 1 · Running an Interpretability Investigation That Holds Up
Symbol C
What this part means
C is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Its job in the formula
C is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol C→Article meaning
The passage around this formula
Once the question is scoped, the experiment that tests it is a causal one by convention in this field, and the convention exists for a good reason: a component correlated with a behaviour has told you nothing about whether the model uses it, while a component that changes the behaviour when intervened on has told you something. The standard instrument is activation patching — running the model on a clean input, running it again on a corrupted one, then substituting the corrupted run’s activations into the clean run at a chosen set of components and measuring the change in some behavioural metric m :
Learn the underlying idea
A variable is a named place for a value. Its letter is a local label: x can mean position in one formula and a data point in another.
Open the illustrated variables: a letter stands for a value guide →
See this notation across published equations →
Sources cited in the article section
- [3] Towards Best Practices of Activation Patching in Language Models: Metrics and Methods ↗
- [4] Causal Scrubbing: A Method for Rigorously Testing Interpretability Hypotheses ↗
- [5] Is This the Subspace You Are Looking for? An Interpretability Illusion for Subspace Activation Patching ↗
- [6] Towards Automated Circuit Discovery for Mechanistic Interpretability ↗
These citations provide research context; check each source for the exact claim it supports.