Equation 15 · How to Evaluate Codex Beyond SWE-bench and Vendor Scores

What does this equation mean?

v_i

Read the formula alongside the article passage below. Each part has a deeper page with its role in the equation, the supporting passage and nearby citations.

the value of correctly completing task i , $C_i$ direct inference and infrastructure cost, $H_i$ human specification and review cost, and $L_i$ loss from an accepted failure. Read the equation part by part below; each part has a contextual explanation and a link to its mathematical background.

Read it piece by piece

v_i

Symbol v_i

the value of correctly completing task i , $C_i$ direct inference and infrastructure cost, $H_i$ human specification and review cost, and $L_i$ loss from an accepted failure.

Understand this part →

subscript

The lower label selects a particular version, component, or indexed member of the quantity. For example, x₀ and xₜ can be values at different positions.

Understand this part →

How to interpret it

Read this expression with the definitions, units, and assumptions supplied by the article.

What the article says around this equation

Let $v_i$ be the value of correctly completing task i , $C_i$ direct inference and infrastructure cost, $H_i$ human specification and review cost, and $L_i$ loss from an accepted failure. Expected net value is

Read the equation in its article →

For background, read the article’s source list.

Return to How to Evaluate Codex Beyond SWE-bench and Vendor Scores

Browse the mathematical compendium →