Equation 7 · Part 1 · Building a Custom Evaluation Suite for a Production Agent
Symbol z_β
What this part means
z_β is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Its job in the formula
z_β is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol z_β→Article meaning
The passage around this formula
…in a fairly ordinary case — a baseline pass rate of 70 percent, a minimum shift worth caring about of 10 percentage points, a 5 percent significance level, and 80 percent power — gives 1.96 and 0.84 , and the formula returns roughly 330 trials per configuration. That number is the whole argument for treating a single failed run, or even three failed runs out of five, with real suspicion rather than as proof of a regression: at ordinary sample sizes, most of what looks…
Learn the underlying idea
A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.
Open the illustrated subscripts: which member of a family? guide →
See this notation across published equations →
Sources cited in the article section
- [1] Demystifying evals for AI agents ↗
- [6] Evaluate systematically ↗
- [2] Your AI Product Needs Evals ↗
- [5] Evaluation best practices ↗
- [7] How to build continuous evaluation for AI agents with trace classifications ↗
These citations provide research context; check each source for the exact claim it supports.