← Mathematical compendium

Published equation contexts

SGLUE=19∑t=19stS_{\mathrm{GLUE}} = \frac{1}{9}\sum_{t=1}^{9} s_t

Why this formula appears here

Wang and colleagues then generalized the single-turn approach across tasks rather than within one, arguing that for language understanding “to be maximally useful, both practically and as a scientific object of study, it must be general: it must be able to process language in a way that is not exclusively tailored to any one specific task or dataset” [ 4 ] . GLUE bundled nine separate tasks — grammatical acceptability, sentiment, paraphrase and similarity judgments, and several varieties of natural-language inference — behind one leaderboard number. That number is worth writing out, because the arithmetic embeds an assumption the field would later revisit: SGLUE=19∑t=19stS_{\mathrm{GLUE}} = \frac{1}{9}\sum_{t=1}^{9} s_t. an unweighted…

Read the full article-specific guide →

Read the representative guide

SGLUES_{\mathrm{GLUE}}

Symbol S_GLUE

SGS_GLUE is part of the quantity the equation computes from the expression on the right.

Read this term in its guide →
tt

Symbol t

t appears in the bound of this sum. The bound states where the repeated operation starts, ends, or which values it includes.

Read this term in its guide →
t=1t=1

Starting index or lower bound: t=1

This label says where the repeated addition, multiplication, or accumulation starts. Read its value or condition together with the article’s description of the index.

Read this term in its guide →
99

Ending index or upper bound: 9

This label says where the repeated addition, multiplication, or accumulation stops. It sets the last term or end of the range.

Read this term in its guide →

How to interpret it

With a fixed numerator, increasing a nonzero denominator reduces the fraction. Read it with the definitions, units, and assumptions supplied by the article.

Research cited beside this formula

Published contexts (1)

A symbol can carry a different meaning in another article. Each occurrence keeps its own guide and term definitions.

SGLUE=19∑t=19st,S_{\mathrm{GLUE}} = \frac{1}{9}\sum_{t=1}^{9} s_t,

Equation 1 · Model Evaluation

A History of How We Learned to Evaluate AI Agents

This equation states an equality: the expressions on both sides have the same value under the article’s assumptions.

Wang and colleagues then generalized the single-turn approach across tasks rather than within one, arguing that for language understanding “to be maximally useful, both practically and as a scientific object of study, it must be general: it must be able to process language in a way that is not exclusively tailored to any one specific task or dataset” [ 4 ] . GLUE bundled nine separate tasks — grammatical acceptability, sentiment, paraphrase and similarity judgments, and several varieties of natural-language inference — behind one leaderboard number. That number is worth writing out, because the arithmetic embeds an assumption the field would later revisit: SGLUE=19∑t=19stS_{\mathrm{GLUE}} = \frac{1}{9}\sum_{t=1}^{9} s_t. an unweighted…

Equation guide → · Article →