Equation 29 · Part 2 · Why Cost and Latency Belong in the Evaluation Score, Not a Footnote
Symbol k
What this part means
k is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Its job in the formula
k is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol k→Article meaning
The passage around this formula
where is a small scheduling and aggregation overhead that grows slowly with k . Two evaluations that both report “an agent retried up to five times” can therefore report latency figures that differ by nearly a factor of five, purely as an artifact of whether those five attempts ran one after another or side by side, with cost looking nearly identical between them. A latency number published without stating the retry and parallelism policy behind it is not comparable to another latency number published under a different policy, even when both describe the same underlying agent on the same task.
Learn the underlying idea
A variable is a named place for a value. Its letter is a local label: x can mean position in one formula and a data point in another.
Open the illustrated variables: a letter stands for a value guide →
See this notation across published equations →
Sources cited in the article section
- [8] Identifying and Mitigating Systemic Measurement Bias in Production LLM Inference Benchmarks ↗
- [10] Towards Reproducible LLM Evaluation: Quantifying Uncertainty in LLM Benchmark Scores ↗
These citations provide research context; check each source for the exact claim it supports.