Equation 9 · Part 1 · Ten Ways an Agent Evaluation Can Mislead You Even When It's Working Correctly
Symbol M
What this part means
M is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Its job in the formula
M is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol M→Article meaning
The passage around this formula
for some error term uncorrelated with U , then selecting the run with the highest M selects simultaneously for high U and for large favorable — the optimizer is drawn toward the tail of the error term as reliably as toward genuine capability, and the more intensely M is optimized, the larger a share of the observed gain is rather than U .
Learn the underlying idea
A variable is a named place for a value. Its letter is a local label: x can mean position in one formula and a data point in another.
Open the illustrated variables: a letter stands for a value guide →
See this notation across published equations →
Sources cited in the article section
- [2] 'Improving ratings': audit in the British University system ↗
- [1] Categorizing Variants of Goodhart's Law ↗
- [3] SWE-Bench+: Enhanced Coding Benchmark for LLMs ↗
These citations provide research context; check each source for the exact claim it supports.