Equation 5 · Part 1 · Ten Ways an Agent Evaluation Can Mislead You Even When It's Working Correctly
Symbol U
What this part means
the highest m selects simultaneously for high.
Its job in the formula
U is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol U→Article meaning
Where the article explains it
for some error term uncorrelated with U , then selecting the run with the highest M selects simultaneously for high U and for large favorable — the optimizer is drawn toward the tail of the error term as reliably as toward genuine capability, and the more intensely M is optimized, the larger a share of the observed gain is rather than U .
The passage around this formula
for some error term uncorrelated with U , then selecting the run with the highest M selects simultaneously for high U and for large favorable — the optimizer is drawn toward the tail of the error term as reliably as toward genuine capability, and the more intensely M is optimized, the larger a share of the observed gain is rather than U .
Learn the underlying idea
A variable is a named place for a value. Its letter is a local label: x can mean position in one formula and a data point in another.
Open the illustrated variables: a letter stands for a value guide →
See this notation across published equations →
Sources cited in the article section
- [2] 'Improving ratings': audit in the British University system ↗
- [1] Categorizing Variants of Goodhart's Law ↗
- [3] SWE-Bench+: Enhanced Coding Benchmark for LLMs ↗
These citations provide research context; check each source for the exact claim it supports.