Model Evaluation
Why Cost and Latency Belong in the Evaluation Score, Not a Footnote
A 95 percent success rate that is slow and expensive can be the worse agent for a job. Scoring only accuracy hides that, and a small set of independent evaluators has started reporting cost and latency as scored dimensions instead of asides.