Equation 1 · Part 2 · Actually Deploying an Open-Weight Model in Production
Symbol R^d × k
What this part means
× k is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Its job in the formula
× k is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol R^d × k→Article meaning
The passage around this formula
Low-Rank Adaptation, LoRA, takes a different approach: it freezes the pretrained weight matrix entirely and represents the update as the product of two much smaller matrices. For a frozen weight matrix , LoRA represents the adapted weight as
Learn the underlying idea
An exponent tells how a base is used in multiplication. In x³, x is the base and 3 is the exponent: x³ = x × x × x.
Open the illustrated exponents: repeated multiplication and powers guide →
See this notation across published equations →
Sources cited in the article section
- [7] Llama Cookbook: LLM Fine-Tuning Overview ↗
- [5] LoRA: Low-Rank Adaptation of Large Language Models ↗
- [6] QLoRA: Efficient Finetuning of Quantized LLMs ↗
These citations provide research context; check each source for the exact claim it supports.