#software engineering benchmarks

Tagged software engineering benchmarks · show all articles

A tray of sealed kraft task-order envelopes on a pale counter with one envelope torn open and its assignment card half-drawn, rows of partitioned work carrels receding beyond under warm daylight

Measuring Claude Code and Agentic Development Tools: Evidence, Benchmarks, and Uncertainty

A leaderboard score, a randomized trial of working developers, and a survey of five thousand engineers are three different instruments. None of them, alone or combined, settles how a given team will fare with an agentic coding tool.

By Brecht Corbeel · August 26, 2026 · 14 min read

A row of four distinct office desks in bright daylight — a terminal desk, a docked-laptop desk, an unattended laptop desk and a standing plan lectern — with a single kraft routing slip caught mid-slide between two of them

AI Agents & Systems

Comparing the Main Approaches to Claude Code and Agentic Development Tools

Claude Code, IDE copilots, autonomous cloud agents, and plan-then-execute systems all give a model shell and file access — but each places approval, memory, and verification somewhere different, and it does not collapse into a ranking.

By Brecht Corbeel · August 26, 2026 · 17 min read

Browse by Category

Surprise me →

All AI Hardware & Semiconductors 100 AI Agents & Systems 42 Foundation Models 30 Model Evaluation 22 AI Industry 12 AI Infrastructure 11 Edge AI & Electronics 9 AI Safety 9 AI Research 9 Open Models 8 History of Technology 5 Invention & Engineering 3 Industry Analysis 2 Datacenters & Infrastructure 2 Writing & Information 1 Structural Biology 1 Small & Edge Models 1 Semiconductor Markets 1 Security & Technology 1 Security 1 Scientific Revolution 1 Robotics & Embodied AI 1 Quantum Information 1 Planetary Science 1 Physics 1 Particle Physics 1 Origins & Astrobiology 1 Open-Weight Models 1 Neuroscience 1 Metrology 1 Mathematics & Computation 1 Materials Science 1 Labour & Technology 1 Interpretability 1 Institutions & State Capacity 1 Institutions & Economy 1 Inference Economics 1 Industrial Revolutions 1 Humanity & Technology 1 History of Computing 1 Governance & Policy 1 Evolution as Mechanism 1 Evolution & Ecology 1 Ethics of Technology 1 Energy & Civilization 1 Earth & Climate 1 Demography & Urbanization 1 Data & Training 1 Cumulative Culture 1 Cosmology 1 Condensed Matter 1 Chemistry & Catalysis 1 Alignment & Safety 1 Agriculture & Cities 1 Agent Evaluation 1 AI Security 1 AI Economics & Systems 1 AI & The Web 1