Symbol s
s is part of the quantity the equation computes from the expression on the right.
Read this term in its guide →Published equation contexts
That range is worth writing as a simple decomposition, because it clarifies exactly what a published score is actually a measurement of: . where is the model’s weights, H is the harness or scaffold wrapped around it, e is the reasoning-effort or thinking-budget setting, is the strength of the test oracle used to grade the output, and is the model’s likely prior exposure to the benchmark’s specific tasks during training. A score gap between two systems is informative about — the thing “OpenAI versus Claude” is supposed to mean — only when H , e , , and are held fixed across both measurements. The evidence above shows that, on the…
s is part of the quantity the equation computes from the expression on the right.
Read this term in its guide →g is an input to the expression that computes the quantity on the left.
Read this term in its guide →phi is an input to the expression that computes the quantity on the left.
Read this term in its guide →Read it with the definitions, units, and assumptions supplied by the article.
A symbol can carry a different meaning in another article. Each occurrence keeps its own guide and term definitions.
Equation 1 · Model Evaluation
This equation states an equality: the expressions on both sides have the same value under the article’s assumptions.
That range is worth writing as a simple decomposition, because it clarifies exactly what a published score is actually a measurement of: . where is the model’s weights, H is the harness or scaffold wrapped around it, e is the reasoning-effort or thinking-budget setting, is the strength of the test oracle used to grade the output, and is the model’s likely prior exposure to the benchmark’s specific tasks during training. A score gap between two systems is informative about — the thing “OpenAI versus Claude” is supposed to mean — only when H , e , , and are held fixed across both measurements. The evidence above shows that, on the…