Equation 17 · Part 1 · Dense, Sparse, and Distilled: Comparing Approaches to Frontier Model Capacity
Symbol N_a
What this part means
is part of the quantity the equation computes from the expression on the right.
Its job in the formula
is part of the quantity the equation computes from the expression on the right.
Full expression→Symbol N_a→Article meaning
The passage around this formula
What sparse routing breaks: = N . Best when training compute is the binding constraint and memory is not.
Learn the underlying idea
A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.
Open the illustrated subscripts: which member of a family? guide →
See this notation across published equations →
Sources cited in the article section
- [4] Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer ↗
- [5] Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity ↗
- [10] Carbon Emissions and Large Neural Network Training ↗
- [9] AI and Memory Wall ↗
These citations provide research context; check each source for the exact claim it supports.