← All parts of this equation

Equation 5 · Part 2 · Building a Custom Evaluation Suite for a Production Agent

Symbol p

n≈2 p(1−p) (zα/2+zβ)2δ2.n \approx \frac{2\,p(1-p)\,(z_{\alpha/2} + z_{\beta})^2}{\delta^2} .
pp

What this part means

p occurs above the fraction bar. The numerator is divided by the entire denominator below it.

Its job in the formula

p occurs above the fraction bar. The numerator is divided by the entire denominator below it.

The passage around this formula

…verdict is itself often a noisy measurement, not a fact, it is worth being explicit about how much noise a single run’s outcome carries before treating a change in the pass rate as real. If a task’s true pass rate is p under a baseline configuration and a candidate change is worth detecting only once it shifts that rate by at least δ\delta , the number of repeated trials needed per configuration to detect the shift reliably — at significance level α\alpha and statistical power 1-β\beta — is approximately…

Read this part in the article →

Learn the underlying idea

A function assigns an output to each allowed input. The expression f(x) means “apply f to x”.

Open the illustrated functions: inputs become outputs guide →

See this notation across published equations →

Sources cited in the article section

These citations provide research context; check each source for the exact claim it supports.