Equation 23 · Part 2 · Cognitive Bias Was the Label; Attention Sink Is the Suspect
subscript
subscript
What this part means
The lower label selects a particular version, component, or indexed member of the quantity. For example, x₀ and xₜ can be values at different positions.
Its job in the formula
A subscript distinguishes a version, component, step, or member of a quantity. It does not automatically mean multiplication.
Full expression→subscript→Article meaning
The passage around this formula
I have not measured for the checkpoints this paper actually tested, and no claim in this article depends on pretending otherwise. Doing so would require training matched softmax and sigmoid-attention models at Llama2 scale — a run measured in GPU-days this article does not have access to — and then rerunning Guo and Vosoughi’s own classification protocol on both. What can be stated precisely is the protocol and the threshold that would settle the question. Train the matched pair at each of the three Llama2 parameter counts the original paper tested — seven billion, thirteen billion, seventy billion — using the released sail-sg/Attention-Sink pipeline; reimplement Guo and…
Learn the underlying idea
A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.
Open the illustrated subscripts: which member of a family? guide →
Sources cited in the article section
These citations provide research context; check each source for the exact claim it supports.