Symbol G

The passage around this formula

That rival predicts several concrete failures. First, $G_{tr}$ will add no held-out predictive value once $q_{tr}$ , $d_t$ , and $h_t$ are present. Second, different reasonable annotation panels will produce unstable rankings of tasks, so any apparent effect will depend on adjudicator taste. Third, the agent contours will be smooth functions of conventional difficulty rather than showing a stable gap-specific shape. Fourth, adding a tool will either help everywhere or merely duplicate one baseline feature. Fifth, tasks that move in G after redaction will not show a matching change in the proposed completion-class distribution when humans are asked what the request permits.

Read this part in the article →