Published equation contexts
Why this formula appears here
Treat a published benchmark score as the output of a function of two arguments: the weights being scored, and the procedure used to score them. Here denotes the model’s parameters and H denotes everything about the evaluation procedure that is not the model itself — the exact prompt template, the number of few-shot examples, whether a chat template is applied, how the model’s free-text output is parsed into a scored answer, and the decoding configuration. A vendor publishes one value of s . An independent lab computing its own s' is implicitly testing whether f(, H) = f(', H') , and a mismatch could in principle come from either argument.
Read the representative guide
Symbol f
f is an input to the expression that computes the quantity on the left.
Read this term in its guide →Symbol H
H is an input to the expression that computes the quantity on the left.
Read this term in its guide →How to interpret it
Read it with the definitions, units, and assumptions supplied by the article.
Published contexts (1)
A symbol can carry a different meaning in another article. Each occurrence keeps its own guide and term definitions.
Equation 1 · Open Models
What Open Weights Actually Let You Verify
This equation states an equality: the expressions on both sides have the same value under the article’s assumptions.
Treat a published benchmark score as the output of a function of two arguments: the weights being scored, and the procedure used to score them. Here denotes the model’s parameters and H denotes everything about the evaluation procedure that is not the model itself — the exact prompt template, the number of few-shot examples, whether a chat template is applied, how the model’s free-text output is parsed into a scored answer, and the decoding configuration. A vendor publishes one value of s . An independent lab computing its own s' is implicitly testing whether f(, H) = f(', H') , and a mismatch could in principle come from either argument.