← All parts of this equation

Equation 15 · Part 4 · The Hardest Unsolved Problems in AI Agent Evaluation and Reliability

Symbol w_i

R=1−∑i=1nwi⋅1[trial i failed],R = 1 - \sum_{i=1}^{n} w_i \cdot \mathbb{1}[\text{trial } i \text{ failed}],
wiw_i

What this part means

wiw_i is one of the signed contributions combined to compute the quantity on the left.

Its job in the formula

wiw_i is one of the signed contributions combined to compute the quantity on the left.

The passage around this formula

and contrast it with a severity-weighted version, R=1−∑i=1nwi⋅1[trial i failed]R = 1 - \sum_{i=1}^{n} w_i \cdot \mathbb{1}[\text{trial } i \text{ failed}]. where wiw_i scales each failure by how costly it actually was. Two agents can share an identical p^\hat{p} of, say, ninety-five percent, while one of them fails harmlessly - an unhelpful but reversible answer - and the other fails catastrophically - an irreversible transaction, a deleted repository, a wrong…

Read this part in the article →

Learn the underlying idea

A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.

Open the illustrated subscripts: which member of a family? guide →

See this notation across published equations →

Sources cited in the article section

These citations provide research context; check each source for the exact claim it supports.