Equation 11 · Part 2 · The Hardest Unsolved Problems in Small and On-Device AI
subscript
subscript
What this part means
The lower label selects a particular version, component, or indexed member of the quantity. For example, x₀ and xₜ can be values at different positions.
Its job in the formula
A subscript distinguishes a version, component, step, or member of a quantity. It does not automatically mean multiplication.
Full expression→subscript→Article meaning
The passage around this formula
One standard mitigation is regularization: penalize the optimizer for moving parameters that mattered to earlier tasks. The best-known form estimates a per-parameter importance weight — commonly the diagonal of the Fisher information, — from the old task, and adds it to the new loss:
Learn the underlying idea
A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.
Open the illustrated subscripts: which member of a family? guide →
Sources cited in the article section
- [9] Continual Learning of Large Language Models: A Comprehensive Survey ↗
- [10] Online Continual Learning for Embedded Devices ↗
- [13] On-Device Language Models: A Comprehensive Review ↗
- [11] Catastrophic Forgetting in LLMs: A Comparative Analysis Across Language Tasks ↗
These citations provide research context; check each source for the exact claim it supports.