Equation 7 · Part 1 · Actually Deploying an Open-Weight Model in Production
Symbol r
What this part means
r is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Its job in the formula
r is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol r→Article meaning
The passage around this formula
Only B and A are trained; never moves during fine-tuning [ 5 ] . The effect on trainable parameter count for that one matrix is to fall from dk to r(d + k) , which is small whenever the chosen rank r is small relative to d and k — and because BA can be merged back into after training, LoRA adds no extra inference latency once deployed. Hu and colleagues report, for their comparison against full fine-tuning of GPT-3 175B, up to a…
Learn the underlying idea
A function assigns an output to each allowed input. The expression f(x) means “apply f to x”.
Open the illustrated functions: inputs become outputs guide →
See this notation across published equations →
Sources cited in the surrounding passage
These citations provide research context; check each source for the exact claim it supports.