Equation 2 · Part 1 · A History of Llama and the Open-Weight AI Movement
Symbol P_shared
What this part means
the always-active shared-expert capacity.
Its job in the formula
hared is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol P_shared→Article meaning
Where the article explains it
where is the always-active shared-expert capacity, is the parameter count of one routed expert, and k is the number of routed experts activated per token.
The passage around this formula
where is the always-active shared-expert capacity, is the parameter count of one routed expert, and k is the number of routed experts activated per token. Total capacity scales with the number of experts E available to the router, roughly …
Learn the underlying idea
A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.
Open the illustrated subscripts: which member of a family? guide →
See this notation across published equations →
Sources cited in the article section
- [15] The Llama 4 Herd: The Beginning of a New Era of Natively Multimodal AI Innovation ↗
- [16] Meta's Benchmarks for Its New AI Models Are a Bit Misleading ↗
- [17] Meta's 'Vanilla' Maverick AI Model Ranks Below Rivals on a Popular Chat Benchmark ↗
These citations provide research context; check each source for the exact claim it supports.