Equation 9 · Part 11 · Adapters, Native Pretraining, and Unified Tokens: The Main Multimodal Architectures, Compared
superscript
superscript
What this part means
A raised number can be a power. When it is a label or bound, it selects a case or the upper limit of a sum; the formula’s structure distinguishes these uses.
Its job in the formula
A raised mark can be a power or an index. Its position and the surrounding notation determine which.
Full expression→superscript→Article meaning
The passage around this formula
Meta’s Chameleon commits to the same principle at a much larger scale and is candid that stability, not capability, was the hard engineering problem. It describes itself as “a family of early-fusion token-based mixed-modal models” that interleaves image and text tokens in one sequence, generating either kind at any position, and its authors state directly that this “requires a stable training approach from inception, an alignment recipe, and an architectural parameterization tailored for the early-fusion, token-based, mixed-modal setting” [ 7 ] . The paper documents the failure mode this addresses concretely: without a query-key normalisation step controlling the growth of attention logits,…
Learn the underlying idea
An exponent tells how a base is used in multiplication. In x³, x is the base and 3 is the exponent: x³ = x × x × x.
Open the illustrated exponents: repeated multiplication and powers guide →
Sources cited in the surrounding passage
- [7] Chameleon: Mixed-Modal Early-Fusion Foundation Models ↗
- [8] CM3: A Causal Masked Multimodal Model of the Internet ↗
These citations provide research context; check each source for the exact claim it supports.