← All parts of this equation

Equation 22 · Part 2 · How to Evaluate Codex Beyond SWE-bench and Vendor Scores

Symbol t

ppublic(t)p_{\mathrm{public}}(t)
tt

What this part means

t is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.

Its job in the formula

t is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.

The passage around this formula

If ppublic(t)p_{\mathrm{public}}(t) and pnew(t)p_{\mathrm{new}}(t) diverge as systems are optimized, the gap is itself a measurement. It indicates that leaderboard progress transfers incompletely. The response should be renewed sampling, not retrospective accusation based on score alone.

Read this part in the article →

Learn the underlying idea

A variable is a named place for a value. Its letter is a local label: x can mean position in one formula and a data point in another.

Open the illustrated variables: a letter stands for a value guide →

See this notation across published equations →

The article lists its research sources here.