Equation 2 · Part 2 · The Economics, Energy, and Physical Limits of Claude Code and Agentic Development Tools
Symbol N_active
What this part means
ctive occurs above the fraction bar. The numerator is divided by the entire denominator below it.
Its job in the formula
ctive occurs above the fraction bar. The numerator is divided by the entire denominator below it.
Full expression→Symbol N_active→Article meaning
The passage around this formula
Underneath all of the pricing mechanics sits a constraint pricing cannot remove: generating one token from a large language model is, for most of a request, bound by how fast bytes can move through accelerator memory rather than by how much arithmetic the accelerator can perform. Producing each token requires reading the model’s active weights and the accumulated key-value cache for that request from memory once; the arithmetic performed per byte read is low, so decoding is memory-bandwidth-bound while only the initial processing of a long prompt is compute-bound, a distinction Pope and colleagues formalized in their analysis of transformer inference efficiency [ 15 ] . Approximately,…
Learn the underlying idea
A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.
Open the illustrated subscripts: which member of a family? guide →
See this notation across published equations →
Sources cited in the surrounding passage
- [15] Efficiently Scaling Transformer Inference ↗
- [16] Efficient Memory Management for Large Language Model Serving with PagedAttention ↗
These citations provide research context; check each source for the exact claim it supports.