Foundation Models
From n-Grams to Reasoning Models: A Technical History of the Language Model
The line from Shannon's letter counts to trained deliberation is usually told as one long scaling curve. It was not. It was a sequence of specific bottlenecks, each named, each broken by a different idea.
