Equation 1 · What Open Weights Actually Let You Verify
What does this equation mean?
Read the formula alongside the article passage below. Each part has a deeper page with its role in the equation, the supporting passage and nearby citations.
This equation states an equality: the expressions on both sides have the same value under the article’s assumptions. Read the equation part by part below; each part has a contextual explanation and a link to its mathematical background.
Read it piece by piece
Symbol f
f is an input to the expression that computes the quantity on the left.
Symbol H
H is an input to the expression that computes the quantity on the left.
=
The expressions on both sides represent the same quantity under the stated assumptions.
See an illustrated explanation →How to interpret it
Read it with the definitions, units, and assumptions supplied by the article.
What the article says around this equation
Treat a published benchmark score as the output of a function of two arguments: the weights being scored, and the procedure used to score them. Here denotes the model’s parameters and H denotes everything about the evaluation procedure that is not the model itself — the exact prompt template, the number of few-shot examples, whether a chat template is applied, how the model’s free-text output is parsed into a scored answer, and the decoding configuration. A vendor publishes one value of s . An independent lab computing its own s' is implicitly testing whether f(, H) = f(', H') , and a mismatch could in principle come from either argument.
For background, read the article’s source list.
Return to What Open Weights Actually Let You Verify