← All parts of this equation

Equation 5 · Part 1 · Adapters, Native Pretraining, and Unified Tokens: The Main Multimodal Architectures, Compared

Symbol theta_LM

θLM\theta_{\text{LM}}
θLM\theta_{\text{LM}}

What this part means

thetaLa_LM is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.

Its job in the formula

thetaLa_LM is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.

The passage around this formula

This is the formal shape of “freeze the backbones”: the gradient update is masked to zero everywhere except the bridge parameters θbridge\theta_{\text{bridge}} , so |θbridge\theta_{\text{bridge}}| — a few hundred million parameters in BLIP-2’s case, dramatically fewer than either tower — is the entire quantity being optimised, and θvision\theta_{\text{vision}} and θLM\theta_{\text{LM}} contribute a forward pass but never a gradient.

Read this part in the article →

Learn the underlying idea

A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.

Open the illustrated subscripts: which member of a family? guide →

See this notation across published equations →

Sources cited in the article section

These citations provide research context; check each source for the exact claim it supports.