← All parts of this equation

Equation 12 · Part 1 · The Hardest Unsolved Problems in Frontier AI Model Comparisons

Symbol hats_i,b

s^i,b\hat{s}_{i,b}
s^i,b\hat{s}_{i,b}

What this part means

hatsis_i,b is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.

Its job in the formula

hatsis_i,b is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.

The passage around this formula

…across benchmarks by construction — a multiple-choice knowledge test and a pairwise human-preference vote are not measuring the same projection of θi\theta_i — there is no aggregation operator that turns a vector of s^i,b\hat{s}_{i,b} values into a single number without an additional, unverified assumption about how the gbg_b functions relate to one another. HELM’s response is to refuse the aggregation and publish the matrix. Epoch’s response is to aggregate anyway, for a stated and narrower purpose. Neither is…

Read this part in the article →

Learn the underlying idea

A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.

Open the illustrated subscripts: which member of a family? guide →

See this notation across published equations →

Sources cited in the article section

These citations provide research context; check each source for the exact claim it supports.