Equation 7 · Part 2 · How Llama's Architecture Actually Works, Generation by Generation

Symbol theta_i

m\theta_i

\theta_i

What this part means

thet $a_i$ is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.

thet $a_i$ is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.

Full expressionSymbol theta_iArticle meaning

and a vector at sequence position m has its i -th pair rotated by angle m $\theta_i$ :

A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.

These citations provide research context; check each source for the exact claim it supports.