← All parts of this equation

Equation 1 · Part 3 · A History of How We Learned to Evaluate AI Agents

Symbol s_t

SGLUE=19∑t=19st,S_{\mathrm{GLUE}} = \frac{1}{9}\sum_{t=1}^{9} s_t,
sts_t

What this part means

sts_t is an input to the expression that computes the quantity on the left.

Its job in the formula

sts_t is an input to the expression that computes the quantity on the left.

The passage around this formula

…inference — behind one leaderboard number. That number is worth writing out, because the arithmetic embeds an assumption the field would later revisit: SGLUE=19∑t=19stS_{\mathrm{GLUE}} = \frac{1}{9}\sum_{t=1}^{9} s_t. an unweighted mean of nine task scores sts_t . Averaging like this treats all nine component tasks as equally important and, implicitly, as equally hard and equally reliably measured — an assumption nothing in the construction actually guarantees. It is a real simplifying assumption, not a neutral summary statistic, and it is exactly the…

Read this part in the article →

Learn the underlying idea

A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.

Open the illustrated subscripts: which member of a family? guide →

See this notation across published equations →

Sources cited in the surrounding passage

These citations provide research context; check each source for the exact claim it supports.