Equation 15 · The Real Economics of Shipping a Model to a Device
What does this equation mean?
Read the formula alongside the article passage below. Each part has a deeper page with its role in the equation, the supporting passage and nearby citations.
This equation states an equality: the expressions on both sides have the same value under the article’s assumptions. Read the equation part by part below; each part has a contextual explanation and a link to its mathematical background.
Read it piece by piece
Symbol Q^*_device
evice is part of the quantity the equation computes from the expression on the right.
Symbol C_dev
the fixed, per-release engineering and QA cost of producing and validating the device-tier variant matrix described above — the harness time, the pass/fail sign-off per tier, per quantization scheme, per chip target.
Symbol U
the cost of distributing model updates to the installed fleet, expanded in the next section.
Symbol c_cloud
loud occurs below the fraction bar. The quantity above the bar is divided by this expression; zero is excluded as a denominator.
Symbol c_d
the marginal cost of one additional on-device inference and as the marginal cost of one additional cloud-served inference of the same model.
=
The expressions on both sides represent the same quantity under the stated assumptions.
See an illustrated explanation →subtraction
Subtract the following term or group from the preceding one. A leading minus marks a negative quantity.
subscript
The lower label selects a particular version, component, or indexed member of the quantity. For example, x₀ and xₜ can be values at different positions.
superscript
A raised number can be a power. When it is a label or bound, it selects a case or the upper limit of a sum; the formula’s structure distinguishes these uses.
See an illustrated explanation →Denominator: c_cloud - c_d
The complete quantity below the fraction bar; it must be nonzero for this division.
How to interpret it
With a fixed numerator, increasing a nonzero denominator reduces the fraction. Read it with the definitions, units, and assumptions supplied by the article.
What the article says around this equation
and the break-even query volume — the point at which on-device placement stops costing more than cloud placement — is . This is the same fixed-cost-against-marginal-cost structure that governs any make-versus-buy or capital-versus-operating-expense decision, and it is the structure Qualcomm’s marginal-cost claim silently assumes has already been paid off. Palkhiwala’s statement that an extra inference event is “effectively free” once the device is purchased is a claim about alone; it says nothing about or U , both of which are paid by the model’s operator, not amortized into the price the customer already paid for the phone. Qualcomm’s own public…
Read the full surrounding passage
and the break-even query volume — the point at which on-device placement stops costing more than cloud placement — is . This is the same fixed-cost-against-marginal-cost structure that governs any make-versus-buy or capital-versus-operating-expense decision, and it is the structure Qualcomm’s marginal-cost claim silently assumes has already been paid off. Palkhiwala’s statement that an extra inference event is “effectively free” once the device is purchased is a claim about alone; it says nothing about or U , both of which are paid by the model’s operator, not amortized into the price the customer already paid for the phone. Qualcomm’s own public argument for why matters so much elsewhere in this equation is worth pairing with the CFO’s quote: the company’s 2023 hybrid-AI position paper states that “generative AI-based search cost per query is estimated to increase by 10 times compared to traditional search methods” [ 9 ] — a claim, again, from a party that benefits from cloud inference looking expensive, but directionally consistent with why - is large enough for the equation above to ever favor the device at all.
Sources cited in the surrounding passage
These citations give research context. Read each source to check which claims it supports.
Return to The Real Economics of Shipping a Model to a Device