Equation 3 · Part 1 · From n-Grams to Reasoning Models: A Technical History of the Language Model
Symbol n
What this part means
n is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Its job in the formula
n is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol n→Article meaning
The passage around this formula
It has one fatal structural property. The number of possible contexts grows exponentially in n while the corpus does not, so almost every context of any useful length has been seen zero times. Maximum-likelihood counting assigns those contexts probability zero, and a single zero anywhere in a sentence sends the whole sequence probability to zero. The model is not merely uncertain about unseen material; it is confidently, catastrophically wrong about it.
Learn the underlying idea
A variable is a named place for a value. Its letter is a local label: x can mean position in one formula and a data point in another.
Open the illustrated variables: a letter stands for a value guide →
See this notation across published equations →
Sources cited in the article section
These citations provide research context; check each source for the exact claim it supports.