AI Agents & Systems
Measuring AI Agent Architectures: Evidence, Benchmarks, and Uncertainty
Agent benchmarks report dramatic swings in success rates from one model generation to the next. Look closely, and the harness, the trial count, and what counts as a pass turn out to matter as much as the model does.