Equation 16 · Part 1 · The Hardest Unsolved Problems in Frontier AI Model Comparisons
Symbol delta_i,b
What this part means
delt,b is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Its job in the formula
delt,b is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol delta_i,b→Article meaning
The passage around this formula
Even a single benchmark’s score is compromised if the term above is nonzero: if some of what looks like reasoning is actually recall of a benchmark item, or an item closely resembling it, that appeared in the model’s training data. Public benchmarks such as GSM8k have been circulating on the open web for years, meaning they, and countless worked solutions and discussions of them, are plausible components of any large modern pretraining corpus.
Learn the underlying idea
A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.
Open the illustrated subscripts: which member of a family? guide →
See this notation across published equations →
Sources cited in the article section
These citations provide research context; check each source for the exact claim it supports.