Equation 14 · The Real Economics of Shipping a Model to a Device
What does this equation mean?
Read the formula alongside the article passage below. Each part has a deeper page with its role in the equation, the supporting passage and nearby citations.
This equation states an equality: the expressions on both sides have the same value under the article’s assumptions. Read the equation part by part below; each part has a contextual explanation and a link to its mathematical background.
Read it piece by piece
Symbol T
T is part of the quantity the equation computes from the expression on the right.
Symbol C_device
evice is part of the quantity the equation computes from the expression on the right.
Symbol C_dev
the fixed, per-release engineering and QA cost of producing and validating the device-tier variant matrix described above — the harness time, the pass/fail sign-off per tier, per quantization scheme, per chip target.
Symbol U
the cost of distributing model updates to the installed fleet, expanded in the next section.
Symbol Q
Q is one of the signed contributions combined to compute the quantity on the left.
Symbol c_d
the marginal cost of one additional on-device inference and as the marginal cost of one additional cloud-served inference of the same model.
Symbol C_cloud
loud is one of the signed contributions combined to compute the quantity on the left.
Symbol c_cloud
loud is one of the signed contributions combined to compute the quantity on the left.
=
The expressions on both sides represent the same quantity under the stated assumptions.
See an illustrated explanation →subscript
The lower label selects a particular version, component, or indexed member of the quantity. For example, x₀ and xₜ can be values at different positions.
How to interpret it
Read it with the definitions, units, and assumptions supplied by the article.
What the article says around this equation
Define as the fixed, per-release engineering and QA cost of producing and validating the device-tier variant matrix described above — the harness time, the pass/fail sign-off per tier, per quantization scheme, per chip target. Define U as the cost of distributing model updates to the installed fleet, expanded in the next section. Define as the marginal cost of one additional on-device inference and as the marginal cost of one additional cloud-served inference of the same model. Total cost over Q queries under each placement is . and the break-even query volume — the point at which on-device placement stops costing more than cloud…
Read the full surrounding passage
Define as the fixed, per-release engineering and QA cost of producing and validating the device-tier variant matrix described above — the harness time, the pass/fail sign-off per tier, per quantization scheme, per chip target. Define U as the cost of distributing model updates to the installed fleet, expanded in the next section. Define as the marginal cost of one additional on-device inference and as the marginal cost of one additional cloud-served inference of the same model. Total cost over Q queries under each placement is . and the break-even query volume — the point at which on-device placement stops costing more than cloud placement — is
Sources cited in the article section
These citations give research context. Read each source to check which claims it supports.
Return to The Real Economics of Shipping a Model to a Device