Equation 4 · Part 1 · The Hardest Unsolved Problems in Frontier AI Model Comparisons
Symbol theta_i
What this part means
some unobservable underlying ability vector for model i.
Its job in the formula
thet is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol theta_i→Article meaning
Where the article explains it
where is some unobservable underlying ability vector for model i , is the mapping from ability to expected score that is specific to benchmark b and not shared across benchmarks, is a contamination or leakage term specific to that model-benchmark pair, and is sampling and decoding noise.
The passage around this formula
where is some unobservable underlying ability vector for model i , is the mapping from ability to expected score that is specific to benchmark b and not shared across benchmarks, is a contamination or leakage term specific to that model-benchmark pair, and is…
Learn the underlying idea
A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.
Open the illustrated subscripts: which member of a family? guide →
See this notation across published equations →
Sources cited in the article section
- [7] Holistic Evaluation of Language Models ↗
- [11] AI Capabilities and Benchmarking Hub ↗
- [6] Measuring AI Ability to Complete Long Software Tasks ↗
- [12] Task-Completion Time Horizons of Frontier AI Models ↗
These citations provide research context; check each source for the exact claim it supports.