Published equation contexts
Why this formula appears here
The factor is not decorative. Hinton and colleagues note that because the magnitude of the gradients produced by the soft-target term scales as 1/ , multiplying the term by keeps the relative contribution of the two loss terms roughly stable as T is tuned as a hyperparameter [ 1 ] . Without it, raising the temperature to expose more dark knowledge would simultaneously and silently shrink the gradient signal doing the exposing.
Read the representative guide
How to interpret it
Read this expression with the definitions, units, and assumptions supplied by the article.
Research cited beside this formula
Published contexts (1)
A symbol can carry a different meaning in another article. Each occurrence keeps its own guide and term definitions.
Equation 9 · Edge AI & Electronics
How a Model Actually Gets Small Enough to Run on a Phone
This mathematical expression combines the displayed quantities; its precise role follows from the surrounding article text.
The factor is not decorative. Hinton and colleagues note that because the magnitude of the gradients produced by the soft-target term scales as 1/ , multiplying the term by keeps the relative contribution of the two loss terms roughly stable as T is tuned as a hyperparameter [ 1 ] . Without it, raising the temperature to expose more dark knowledge would simultaneously and silently shrink the gradient signal doing the exposing.