Equation 20 · Part 7 · How to Evaluate Codex Beyond SWE-bench and Vendor Scores
Symbol q_i
What this part means
the probability a failure escapes detection and is accepted.
Its job in the formula
is one of the signed contributions combined to compute the quantity on the left.
Full expression→Symbol q_i→Article meaning
Where the article explains it
where is the probability a failure escapes detection and is accepted.
The passage around this formula
Let be the value of correctly completing task i , direct inference and infrastructure cost, human specification and review cost, and loss from an accepted failure. Expected net value is . where is the probability a failure escapes detection and is accepted. A high resolve rate can have negative utility if it requires extreme review or creates rare, expensive escapes. A lower autonomous rate can be valuable if the system reliably identifies useful partial progress and makes review cheap.
Learn the underlying idea
A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.
Open the illustrated subscripts: which member of a family? guide →
See this notation across published equations →
The article lists its research sources here.