← Mathematical compendium

Published equation contexts

Bj=(Ntokens,Nturns,Ntools,twall,Ccompute,kattempts)B_j=(N_{\mathrm{tokens}},N_{\mathrm{turns}},N_{\mathrm{tools}},t_{\mathrm{wall}},C_{\mathrm{compute}},k_{\mathrm{attempts}})

Why this formula appears here

For system j , report a resource vector Bj=(Ntokens,Nturns,Ntools,twall,Ccompute,kattempts)B_j=(N_{\mathrm{tokens}},N_{\mathrm{turns}},N_{\mathrm{tools}},t_{\mathrm{wall}},C_{\mathrm{compute}},k_{\mathrm{attempts}}). A resolution curve p(B) is more informative than one point. It reveals marginal returns: whether twice the budget buys substantial success, tiny gains, or merely longer trajectories. It also lets organizations choose configurations on a cost-quality frontier.

Read the full article-specific guide →

Read the representative guide

NtokensN_{\mathrm{tokens}}

Symbol N_tokens

NtN_tokens is an input to the expression that computes the quantity on the left.

Read this term in its guide →
NturnsN_{\mathrm{turns}}

Symbol N_turns

NtN_turns is an input to the expression that computes the quantity on the left.

Read this term in its guide →
NtoolsN_{\mathrm{tools}}

Symbol N_tools

NtN_tools is an input to the expression that computes the quantity on the left.

Read this term in its guide →
twallt_{\mathrm{wall}}

Symbol t_wall

twt_wall is an input to the expression that computes the quantity on the left.

Read this term in its guide →
CcomputeC_{\mathrm{compute}}

Symbol C_compute

CcC_compute is an input to the expression that computes the quantity on the left.

Read this term in its guide →
kattemptsk_{\mathrm{attempts}}

Symbol k_attempts

kak_attempts is an input to the expression that computes the quantity on the left.

Read this term in its guide →

How to interpret it

Read it with the definitions, units, and assumptions supplied by the article.

Learn the mathematics behind it

Published contexts (1)

A symbol can carry a different meaning in another article. Each occurrence keeps its own guide and term definitions.

Bj=(Ntokens,Nturns,Ntools,twall,Ccompute,kattempts).B_j=(N_{\mathrm{tokens}},N_{\mathrm{turns}},N_{\mathrm{tools}},t_{\mathrm{wall}},C_{\mathrm{compute}},k_{\mathrm{attempts}}).

Equation 8 · Model Evaluation

How to Evaluate Codex Beyond SWE-bench and Vendor Scores

This equation states an equality: the expressions on both sides have the same value under the article’s assumptions.

For system j , report a resource vector Bj=(Ntokens,Nturns,Ntools,twall,Ccompute,kattempts)B_j=(N_{\mathrm{tokens}},N_{\mathrm{turns}},N_{\mathrm{tools}},t_{\mathrm{wall}},C_{\mathrm{compute}},k_{\mathrm{attempts}}). A resolution curve p(B) is more informative than one point. It reveals marginal returns: whether twice the budget buys substantial success, tiny gains, or merely longer trajectories. It also lets organizations choose configurations on a cost-quality frontier.

Equation guide → · Article →