Equation 2 · Part 4 · Building a Multimodal AI Application That Actually Uses Its Inputs
Symbol Δ W
What this part means
Δ W is one of the signed contributions combined to compute the quantity on the left.
Its job in the formula
Δ W is one of the signed contributions combined to compute the quantity on the left.
Full expression→Symbol Δ W→Article meaning
The passage around this formula
with the forward pass computing h = x + W x against the frozen base weight . The method’s authors report reducing the number of trainable parameters by roughly ten thousand times and GPU memory requirements by roughly three times relative to full fine-tuning of a 175-billion-parameter model, while matching or exceeding full…
Learn the underlying idea
A variable is a named place for a value. Its letter is a local label: x can mean position in one formula and a data point in another.
Open the illustrated variables: a letter stands for a value guide →
See this notation across published equations →
Sources cited in the surrounding passage
- [1] LoRA: Low-Rank Adaptation of Large Language Models ↗
- [2] QLoRA: Efficient Finetuning of Quantized LLMs ↗
- [10] PEFT: Parameter-Efficient Fine-Tuning ↗
These citations provide research context; check each source for the exact claim it supports.