← All parts of this equation

Equation 20 · Part 2 · How to Evaluate Codex Beyond SWE-bench and Vendor Scores

Symbol i

U=∑i[pivi−Ci−Hi−(1−pi) qiLi],U=\sum_i\left[p_i v_i-C_i-H_i-(1-p_i)\,q_i L_i\right],
ii

What this part means

i appears in the bound of this sum. The bound states where the repeated operation starts, ends, or which values it includes.

Its job in the formula

i appears in the bound of this sum. The bound states where the repeated operation starts, ends, or which values it includes.

The passage around this formula

Let viv_i be the value of correctly completing task i , CiC_i direct inference and infrastructure cost, HiH_i human specification and review cost, and LiL_i loss from an accepted failure. Expected net value is U=∑i[pivi−Ci−Hi−(1−pi) qiLi]U=\sum_i\left[p_i v_i-C_i-H_i-(1-p_i)\,q_i L_i\right]. where qiq_i is the probability a failure escapes detection and is accepted. A high resolve rate can have negative utility if it requires extreme review or creates rare, expensive escapes. A lower autonomous rate can be valuable if the system reliably identifies useful partial progress and makes review cheap.

Read this part in the article →

Learn the underlying idea

A variable is a named place for a value. Its letter is a local label: x can mean position in one formula and a data point in another.

Open the illustrated variables: a letter stands for a value guide →

See this notation across published equations →

The article lists its research sources here.