Equation 17 · AI Inference Economics in Practice: An Advanced Technical Guide
What does this equation mean?
Read the formula alongside the article passage below. Each part has a deeper page with its role in the equation, the supporting passage and nearby citations.
This equation states an equality: the expressions on both sides have the same value under the article’s assumptions. Read the equation part by part below; each part has a contextual explanation and a link to its mathematical background.
Read it piece by piece
Symbol u^*
is the quantity selected or evaluated by the optimization written on the right.
=
The expressions on both sides represent the same quantity under the stated assumptions.
See an illustrated explanation →subscript
The lower label selects a particular version, component, or indexed member of the quantity. For example, x₀ and xₜ can be values at different positions.
superscript
A raised number can be a power. When it is a label or bound, it selects a case or the upper limit of a sum; the formula’s structure distinguishes these uses.
See an illustrated explanation →Denominator: Q_max c_od
The complete quantity below the fraction bar; it must be nonzero for this division.
How to interpret it
With a fixed numerator, increasing a nonzero denominator reduces the fraction. Read it with the definitions, units, and assumptions supplied by the article.
What the article says around this equation
The arithmetic is simple once both prices are in hand, and generalizes across any reserved-capacity product structured this way. Let be the reserved capacity’s price per hour, the maximum throughput it sustains per hour at full utilization, and the effective on-demand cost of the equivalent work. At actual utilization u , the effective cost per unit under reservation is / (u \, ) , and reservation wins exactly when . is cleared. Utilization above favours reservation; below it favours paying as you go. The formula’s value is what it forces a team to measure honestly before signing: not peak throughput or a favourable week’s…
Read the full surrounding passage
The arithmetic is simple once both prices are in hand, and generalizes across any reserved-capacity product structured this way. Let be the reserved capacity’s price per hour, the maximum throughput it sustains per hour at full utilization, and the effective on-demand cost of the equivalent work. At actual utilization u , the effective cost per unit under reservation is / (u \, ) , and reservation wins exactly when . is cleared. Utilization above favours reservation; below it favours paying as you go. The formula’s value is what it forces a team to measure honestly before signing: not peak throughput or a favourable week’s average, but utilization sustained across the full commitment term including the slow periods — capacity sized to a launch-week peak and left running at a quarter of that traffic for the following eleven months has pre-paid idle time at the reserved rate.
Sources cited in the article section
- [11] Increase Model Invocation Capacity with Provisioned Throughput in Amazon Bedrock ↗
- [17] Optimization and Tuning ↗
- [15] Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving ↗
These citations give research context. Read each source to check which claims it supports.
Return to AI Inference Economics in Practice: An Advanced Technical Guide