Symbol τ
τ is part of the quantity the equation computes from the expression on the right.
Read this term in its guide →Published equation contexts
Why this formula appears here
A language model evaluation is, structurally, a function from a prompt to a string. Grading the string may be very hard, but the object being graded is small, static, and fully observed. An agent produces something categorically larger. The natural unit of observation is a trajectory: . an initial environment state, an ordered sequence of actions with the observations they returned, and a terminal state. Everything that separates a competent run from a lucky one lives in the middle terms. A conventional success indicator reads only the last one.
Read the representative guide
Symbol s_0
is an input to the expression that computes the quantity on the left.
Read this term in its guide →Symbol a_1
is an input to the expression that computes the quantity on the left.
Read this term in its guide →Symbol o_1
is an input to the expression that computes the quantity on the left.
Read this term in its guide →Symbol a_n
is an input to the expression that computes the quantity on the left.
Read this term in its guide →Symbol o_n
is an input to the expression that computes the quantity on the left.
Read this term in its guide →Symbol s_n
is an input to the expression that computes the quantity on the left.
Read this term in its guide →How to interpret it
Read it with the definitions, units, and assumptions supplied by the article.
Published contexts (1)
A symbol can carry a different meaning in another article. Each occurrence keeps its own guide and term definitions.
Equation 1 · Agent Evaluation
Evaluating Trajectories, Not Answers
This equation states an equality: the expressions on both sides have the same value under the article’s assumptions.
A language model evaluation is, structurally, a function from a prompt to a string. Grading the string may be very hard, but the object being graded is small, static, and fully observed. An agent produces something categorically larger. The natural unit of observation is a trajectory: . an initial environment state, an ordered sequence of actions with the observations they returned, and a terminal state. Everything that separates a competent run from a lucky one lives in the middle terms. A conventional success indicator reads only the last one.
Equation guide → · Article →