← All parts of this equation

Equation 2 · Part 1 · Measuring Frontier Models: Contamination, Variance, and What a Score Can Support

Symbol s

ss
ss

What this part means

s is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.

Its job in the formula

s is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.

The passage around this formula

Reframe the object. A benchmark score s^\hat{s} is an estimator of a population quantity s — the model’s success rate over some distribution of tasks D\mathcal{D} that somebody hopes resembles the work you actually have. Every property that makes an estimator trustworthy applies:

Read this part in the article →

Learn the underlying idea

A variable is a named place for a value. Its letter is a local label: x can mean position in one formula and a data point in another.

Open the illustrated variables: a letter stands for a value guide →

See this notation across published equations →

The article lists its research sources here.