Equation 2 · Part 8 · Building a Multimodal AI Application That Actually Uses Its Inputs
subscript
subscript
What this part means
The lower label selects a particular version, component, or indexed member of the quantity. For example, x₀ and xₜ can be values at different positions.
Its job in the formula
A subscript distinguishes a version, component, step, or member of a quantity. It does not automatically mean multiplication.
Full expression→subscript→Article meaning
The passage around this formula
with the forward pass computing h = x + W x against the frozen base weight . The method’s authors report reducing the number of trainable parameters by roughly ten thousand times and GPU memory requirements by roughly three times relative to full fine-tuning of a 175-billion-parameter model, while matching or exceeding full fine-tuning quality and adding no additional inference latency, since the low-rank update can be merged back into the base weight at deployment time [ 1 ] . QLoRA extends the same idea to quantized base weights, and its authors report finetuning a 65-billion-parameter model on a single 48-gigabyte GPU while preserving full 16-bit finetuning performance,…
Learn the underlying idea
A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.
Open the illustrated subscripts: which member of a family? guide →
Sources cited in the surrounding passage
- [1] LoRA: Low-Rank Adaptation of Large Language Models ↗
- [2] QLoRA: Efficient Finetuning of Quantized LLMs ↗
- [10] PEFT: Parameter-Efficient Fine-Tuning ↗
These citations provide research context; check each source for the exact claim it supports.