Equation 9 · Part 6 · Probing, Sparse Autoencoders, Patching, and Steering: The Main Interpretability Methods, Compared
Symbol θ
What this part means
θ is one of the signed contributions combined to compute the quantity on the left.
Its job in the formula
θ is one of the signed contributions combined to compute the quantity on the left.
Full expression→Symbol θ→Article meaning
The passage around this formula
…feature, distorting reconstruction in a way that has nothing to do with how many features are active. Rajamanoharan and colleagues introduced JumpReLU, a thresholded activation function with a learned per-feature cutoff trained through a straight-through gradient estimator, which lets the objective penalise the true count of active features, f(x) , directly rather than through the proxy, and reported state-of-the-art reconstruction fidelity at matched sparsity against both the earlier…
Learn the underlying idea
A variable is a named place for a value. Its letter is a local label: x can mean position in one formula and a data point in another.
Open the illustrated variables: a letter stands for a value guide →
See this notation across published equations →
Sources cited in the surrounding passage
These citations provide research context; check each source for the exact claim it supports.