Model Evaluation
Why Average Success Rate Hides the Failures That Matter Most
A 99 percent success rate says nothing about what the other one percent contains. Evaluating an agent for consequence, not just frequency, is a different discipline, with its own tests and its own statistics.