Equation 2 · Part 8 · What Claude's Capability Evaluations Actually Measure
Numerator: 1
What this part means
The complete quantity above the fraction bar.
Its job in the formula
1 is one of the signed contributions combined to compute the quantity on the left.
Full expression→Numerator: 1→Article meaning
The passage around this formula
The method is a curve fit, not a lookup table, and stating it plainly exposes the assumption it rests on. For a task of human-expert duration t , METR fits a logistic curve to the model’s observed success rate across many tasks of varying length: . with b > 0 , so predicted success falls as human-equivalent task length grows. The reported time horizon at success level x is then the duration at which the fitted curve crosses that threshold, i.e. the t solving p(t) = x . Two things follow directly from this formulation that a single reported number obscures: the curve, not the crossing point, is the actual result, and a different chosen threshold x produces a different…
Learn the underlying idea
A fraction a/b means a divided by b. The top number is the numerator; the bottom number is the denominator, and it cannot be zero.
Open the illustrated fractions: division written vertically guide →
Sources cited in the article section
- [7] Measuring AI Ability to Complete Long Tasks ↗
- [8] Task-Completion Time Horizons of Frontier AI Models ↗
These citations provide research context; check each source for the exact claim it supports.