Equation 19 · Part 1 · AI Inference Economics in Practice: An Advanced Technical Guide
Symbol c_od
What this part means
the effective on-demand cost of the equivalent work.
Its job in the formula
d is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol c_od→Article meaning
Where the article explains it
Let be the reserved capacity’s price per hour, the maximum throughput it sustains per hour at full utilization, and the effective on-demand cost of the equivalent work.
The passage around this formula
This is where the earlier levers become procurement inputs rather than separate decisions. A caching strategy that lifts realized hit rate lowers , which raises the utilization bar a reservation has to clear — a workload with an excellent hit rate needs steadier , not just larger , volume to justify reserving, because caching already captured much of the available saving on-demand. A routing policy shrinking the volume on…
Learn the underlying idea
A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.
Open the illustrated subscripts: which member of a family? guide →
See this notation across published equations →
Sources cited in the article section
- [11] Increase Model Invocation Capacity with Provisioned Throughput in Amazon Bedrock ↗
- [17] Optimization and Tuning ↗
- [15] Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving ↗
These citations provide research context; check each source for the exact claim it supports.