Equation 5 · Part 1 · Claude, From First Principles: Training, Constitutional Methods, and What Actually Shapes a Response
Symbol D
What this part means
the number of training tokens, the factor of six accounting for the forward and backward pass together.
Its job in the formula
D is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol D→Article meaning
Where the article explains it
where N is the parameter count and D is the number of training tokens, the factor of six accounting for the forward and backward pass together.
The passage around this formula
where N is the parameter count and D is the number of training tokens, the factor of six accounting for the forward and backward pass together. Kaplan and colleagues showed empirically that test loss falls as a power law in each of N , D , and compute across many orders of magnitude, with a functional form that includes an irreducible floor: doubling the parameter count buys a fixed decrement in loss, not a fixed multiple of capability [ 12 ] . That single empirical regularity is a large part of why frontier pretraining runs keep growing and why each one produces diminishing, rather than accelerating, returns.
Learn the underlying idea
A variable is a named place for a value. Its letter is a local label: x can mean position in one formula and a data point in another.
Open the illustrated variables: a letter stands for a value guide →
See this notation across published equations →
Sources cited in the surrounding passage
These citations provide research context; check each source for the exact claim it supports.