← All parts of this equation

Equation 1 · Part 4 · How Benchmark Contamination Actually Works in Agentic Evaluation

Symbol Delta_checker

sobserved=scapability+Δleak+Δchecker+Δfingerprints_{\text{observed}} = s_{\text{capability}} + \Delta_{\text{leak}} + \Delta_{\text{checker}} + \Delta_{\text{fingerprint}}
Δchecker\Delta_{\text{checker}}

What this part means

inflation from a verifier that can be satisfied by something other than a correct solution — a weak test suite, a policy that exploits how success is graded rather than what it is graded on.

Its job in the formula

Deltaca_checker is one of the signed contributions combined to compute the quantity on the left.

Where the article explains it

Δchecker\Delta_{\text{checker}} is inflation from a verifier that can be satisfied by something other than a correct solution — a weak test suite, a policy that exploits how success is graded rather than what it is graded on.

The passage around this formula

…solve genuinely novel instances of this task class. Δleak\Delta_{\text{leak}} is inflation from the environment itself disclosing the solution — through its history, its documentation, or a live network path to the answer. Δchecker\Delta_{\text{checker}} is inflation from a verifier that can be satisfied by something other than a correct solution — a weak test suite, a policy that exploits how success is graded rather than what it is graded on. Δfingerprint\Delta_{\text{fingerprint}} is a shift, in either direction, from the policy…

Read this part in the article →

Learn the underlying idea

A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.

Open the illustrated subscripts: which member of a family? guide →

See this notation across published equations →

The article lists its research sources here.