Equation 27 · Part 1 · Why Cost and Latency Belong in the Evaluation Score, Not a Footnote
Symbol C
What this part means
C is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Its job in the formula
C is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol C→Article meaning
The passage around this formula
Start with how an agent handles its own failures. Suppose a task is retried up to k times under two different execution policies: sequential retry, where each attempt waits for the previous one to finish before starting, and parallel sampling, where all k attempts run concurrently and the first success is taken. Cost is roughly indifferent to which policy was used — the compute consumed scales with the number of attempts made, C(k) k , regardless of whether they ran one after another or all at once. Latency is not indifferent at all:
Learn the underlying idea
A function assigns an output to each allowed input. The expression f(x) means “apply f to x”.
Open the illustrated functions: inputs become outputs guide →
See this notation across published equations →
Sources cited in the article section
- [8] Identifying and Mitigating Systemic Measurement Bias in Production LLM Inference Benchmarks ↗
- [10] Towards Reproducible LLM Evaluation: Quantifying Uncertainty in LLM Benchmark Scores ↗
These citations provide research context; check each source for the exact claim it supports.