Equation 11 · Part 1 · A History of Llama and the Open-Weight AI Movement

Symbol k

k

k

What this part means

the number of routed experts activated per token.

Its job in the formula

k is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.

Full expressionSymbol kArticle meaning

Where the article explains it

where $P_{\mathrm{shared}}$ is the always-active shared-expert capacity, $P_{\mathrm{expert}}$ is the parameter count of one routed expert, and k is the number of routed experts activated per token.

The passage around this formula

where $P_{\mathrm{shared}}$ is the always-active shared-expert capacity, $P_{\mathrm{expert}}$ is the parameter count of one routed expert, and k is the number of routed experts activated per token. Total capacity scales with the number of experts E available to the router, roughly $P_{\mathrm{total}}$ $\approx$ $P_{\mathrm{shared}}$ + E $\cdot$ $P_{\mathrm{expert}}$ , while inference compute scales with $P_{\mathrm{active}}$ , not $P_{\mathrm{total}}$ …

Read this part in the article →

Learn the underlying idea

A variable is a named place for a value. Its letter is a local label: x can mean position in one formula and a data point in another.

Open the illustrated variables: a letter stands for a value guide →

See this notation across published equations →

Sources cited in the article section

These citations provide research context; check each source for the exact claim it supports.