Equation 6 · A History of Small and On-Device AI
What does this equation mean?
Read the formula alongside the article passage below. Each part has a deeper page with its role in the equation, the supporting passage and nearby citations.
This equation states an equality: the expressions on both sides have the same value under the article’s assumptions. Read the equation part by part below; each part has a contextual explanation and a link to its mathematical background.
Read it piece by piece
Symbol D_K
is part of the quantity the equation computes from the expression on the right.
Symbol M
M is part of the quantity the equation computes from the expression on the right.
Symbol D_F
is part of the quantity the equation computes from the expression on the right.
Symbol N
N is part of the quantity the equation computes from the expression on the right.
Symbol D_K^2
occurs below the fraction bar. The quantity above the bar is divided by this expression; zero is excluded as a denominator.
=
The expressions on both sides represent the same quantity under the stated assumptions.
See an illustrated explanation →subscript
The lower label selects a particular version, component, or indexed member of the quantity. For example, x₀ and xₜ can be values at different positions.
superscript
A raised number can be a power. When it is a label or bound, it selects a case or the upper limit of a sum; the formula’s structure distinguishes these uses.
See an illustrated explanation →Numerator: D_K × D_K × M × D_F × D_F + M × N × D_F × D_F
The complete quantity above the fraction bar.
Denominator: D_K × D_K × M × N × D_F × D_F
The complete quantity below the fraction bar; it must be nonzero for this division.
How to interpret it
With a fixed numerator, increasing a nonzero denominator reduces the fraction. Read it with the definitions, units, and assumptions supplied by the article.
What the article says around this equation
MobileNet, published by Howard and colleagues at Google fourteen months later, generalized the same idea into a reusable building block rather than one bespoke network. A standard convolutional layer filters and combines its inputs in a single step; MobileNet’s depthwise separable convolution splits that into a depthwise layer that filters each input channel on its own, followed by a 1×1 pointwise convolution that recombines the results [ 1 ] . For a kernel, M input channels, N output channels and a feature map, a standard convolution costs M N multiply-adds. The paper gives the depthwise separable replacement’s…
Read the full surrounding passage
MobileNet, published by Howard and colleagues at Google fourteen months later, generalized the same idea into a reusable building block rather than one bespoke network. A standard convolutional layer filters and combines its inputs in a single step; MobileNet’s depthwise separable convolution splits that into a depthwise layer that filters each input channel on its own, followed by a 1×1 pointwise convolution that recombines the results [ 1 ] . For a kernel, M input channels, N output channels and a feature map, a standard convolution costs M N multiply-adds. The paper gives the depthwise separable replacement’s cost, and its ratio to the standard cost, directly: . With the near-universal 33 kernel, that ratio works out to roughly an eighth to a ninth of the original computation, for what the paper reports as a small accuracy cost [ 1 ] . MobileNet then added two further dials rather than shipping one fixed shape: a width multiplier that uniformly thins the number of channels at every layer, and a resolution multiplier that shrinks the input image, letting a developer choose a point on an accuracy-versus-latency curve instead of accepting whatever a single published checkpoint offered [ 1 ] . That is the detail worth keeping from this stage of the history: SqueezeNet showed that a deliberately designed structure could match a much larger network’s accuracy at a fraction of the parameters; MobileNet turned the same insight into a convolution that could be dropped into any architecture, with knobs that let one trained design be retargeted across a whole range of phones rather than retrained for each.
Sources cited in the surrounding passage
These citations give research context. Read each source to check which claims it supports.
Return to A History of Small and On-Device AI