← Mathematical compendium

Published equation contexts

n=500n = 500

Why this formula appears here

For n = 500 and p^\hat p near one half, this is on the order of two percentage points — before accounting for the additional variance introduced by sampling temperature, agentic scaffolding, or a different number of retries per problem. A published gap of four or five points between two systems evaluated under different harnesses, different reasoning-effort settings, and different retry budgets is not obviously a capability gap at all; it may be substantially a measurement-configuration gap. This is precisely why the practice of building a single cross-vendor leaderboard out of self-reported scores, each collected under undisclosed or differing scaffolds, is not a defensible ranking — it is…

Read the full article-specific guide →

Read the representative guide

How to interpret it

Read it with the definitions, units, and assumptions supplied by the article.

Research cited beside this formula

Published contexts (1)

A symbol can carry a different meaning in another article. Each occurrence keeps its own guide and term definitions.

n=500n = 500

Equation 6 · AI Agents & Systems

Measuring Claude Code and Agentic Development Tools: Evidence, Benchmarks, and Uncertainty

This equation states an equality: the expressions on both sides have the same value under the article’s assumptions.

For n = 500 and p^\hat p near one half, this is on the order of two percentage points — before accounting for the additional variance introduced by sampling temperature, agentic scaffolding, or a different number of retries per problem. A published gap of four or five points between two systems evaluated under different harnesses, different reasoning-effort settings, and different retry budgets is not obviously a capability gap at all; it may be substantially a measurement-configuration gap. This is precisely why the practice of building a single cross-vendor leaderboard out of self-reported scores, each collected under undisclosed or differing scaffolds, is not a defensible ranking — it is…

Equation guide → · Article →