← All parts of this equation

Equation 1 · Part 3 · Comparing the Main Approaches to AI Inference Economics

Symbol N_dense

CdenseCMoE≈NdenseNactive\frac{C_{\mathrm{dense}}}{C_{\mathrm{MoE}}} \approx \frac{N_{\mathrm{dense}}}{N_{\mathrm{active}}}
NdenseN_{\mathrm{dense}}

What this part means

NdN_dense occurs above the fraction bar. The numerator is divided by the entire denominator below it.

Its job in the formula

NdN_dense occurs above the fraction bar. The numerator is divided by the entire denominator below it.

The passage around this formula

…Approximating compute per token as proportional to the parameter count actually touched [ 13 , 11 ] , the ratio of dense to MoE compute at equal activated size is approximately CdenseCMoE≈NdenseNactive\frac{C_{\mathrm{dense}}}{C_{\mathrm{MoE}}} \approx \frac{N_{\mathrm{dense}}}{N_{\mathrm{active}}}. for a dense model with NdenseN_{\mathrm{dense}} parameters compared against an MoE model activating NactiveN_{\mathrm{active}} of its NtotalN_{\mathrm{total}} parameters per token. What this ratio hides is exactly what a compute-only comparison always hides: memory. Serving an MoE model requires holding all NtotalN_{\mathrm{total}} parameters…

Read this part in the article →

Learn the underlying idea

A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.

Open the illustrated subscripts: which member of a family? guide →

See this notation across published equations →

Sources cited in the article section

These citations provide research context; check each source for the exact claim it supports.