← All parts of this equation

Equation 1 · Part 5 · How Benchmark Contamination Actually Works in Agentic Evaluation

Symbol Delta_fingerprint

sobserved=scapability+Δleak+Δchecker+Δfingerprints_{\text{observed}} = s_{\text{capability}} + \Delta_{\text{leak}} + \Delta_{\text{checker}} + \Delta_{\text{fingerprint}}
Δfingerprint\Delta_{\text{fingerprint}}

What this part means

a shift, in either direction, from the policy detecting that it is inside an evaluation and adjusting its behavior because of that detection alone, independent of the task.

Its job in the formula

Deltafa_fingerprint is one of the signed contributions combined to compute the quantity on the left.

Where the article explains it

Δfingerprint\Delta_{\text{fingerprint}} is a shift, in either direction, from the policy detecting that it is inside an evaluation and adjusting its behavior because of that detection alone, independent of the task.

The passage around this formula

…Δchecker\Delta_{\text{checker}} is inflation from a verifier that can be satisfied by something other than a correct solution — a weak test suite, a policy that exploits how success is graded rather than what it is graded on. Δfingerprint\Delta_{\text{fingerprint}} is a shift, in either direction, from the policy detecting that it is inside an evaluation and adjusting its behavior because of that detection alone, independent of the task. A single-turn benchmark has to worry about something close to Δleak\Delta_{\text{leak}} alone. An…

Read this part in the article →

Learn the underlying idea

A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.

Open the illustrated subscripts: which member of a family? guide →

See this notation across published equations →

The article lists its research sources here.