Equation 15 · Part 5 · Ten Ways an Agent Evaluation Can Mislead You Even When It's Working Correctly
Numerator: hatp(1-hatp)
What this part means
The complete quantity above the fraction bar.
Its job in the formula
hatp(1-hatp) occurs above the fraction bar. The numerator is divided by the entire denominator below it.
Full expression→Numerator: hatp(1-hatp)→Article meaning
The passage around this formula
4. Insufficient trial counts producing false confidence. A success rate reported from a small number of trials carries a much wider margin of error than the single reported number suggests, and the interval widens fast as the trial count shrinks. For a naive binomial estimate — treating each trial as an independent coin flip with unknown success probability p — the 95 percent confidence interval around an observed rate from n trials is approximately . At ten trials and an observed 90 percent success rate, that formula gives an interval of roughly plus or minus nineteen percentage points — an agent genuinely succeeding anywhere from about 71 percent to essentially…
Learn the underlying idea
A fraction a/b means a divided by b. The top number is the numerator; the bottom number is the denominator, and it cannot be zero.
Open the illustrated fractions: division written vertically guide →
Sources cited in the surrounding passage
These citations provide research context; check each source for the exact claim it supports.