#AI benchmarks

Tagged AI benchmarks · show all articles

A sealed aluminium test-set canister half-loaded into a locked reader console, its collar caught mid-turn, with a rack of isolated per-vendor query ports receding behind it

What Independent Evidence Actually Supports About Grok's Capabilities

xAI publishes a number, a rival's engineer disputes the method behind it, and an outside lab reruns the test months later. This article follows three documented rounds of that cycle to build a method for weighing any of them.

By Brecht Corbeel · August 23, 2026 · 16 min read

Two paper run-log transcripts laid side by side on a long comparison table, a wax pencil caught mid-stroke circling one mismatched line between them

Model Evaluation

What a Single Benchmark Score Can and Can't Tell You

A score like SWE-bench 74 percent looks like a fact about a model. It is really a fact about a model, a harness, a task subset, and a date bundled together, and mixing those up is the most common way to misread a benchmark.

By Brecht Corbeel · August 23, 2026 · 6 min read

Browse by Category

Surprise me →

All AI Hardware & Semiconductors 100 AI Agents & Systems 38 Foundation Models 30 Model Evaluation 19 AI Industry 12 Edge AI & Electronics 9 AI Safety 9 AI Research 9 Open Models 8 AI Infrastructure 8 Industry Analysis 2 Datacenters & Infrastructure 2 Writing & Information 1 Structural Biology 1 Small & Edge Models 1 Semiconductor Markets 1 Security & Technology 1 Security 1 Scientific Revolution 1 Robotics & Embodied AI 1 Quantum Information 1 Planetary Science 1 Physics 1 Particle Physics 1 Origins & Astrobiology 1 Open-Weight Models 1 Neuroscience 1 Metrology 1 Mathematics & Computation 1 Materials Science 1 Labour & Technology 1 Interpretability 1 Institutions & State Capacity 1 Institutions & Economy 1 Inference Economics 1 Industrial Revolutions 1 Humanity & Technology 1 History of Technology 1 History of Computing 1 Governance & Policy 1 Evolution & Ecology 1 Ethics of Technology 1 Energy & Civilization 1 Earth & Climate 1 Demography & Urbanization 1 Data & Training 1 Cumulative Culture 1 Cosmology 1 Condensed Matter 1 Chemistry & Catalysis 1 Alignment & Safety 1 Agriculture & Cities 1 Agent Evaluation 1 AI Security 1 AI Economics & Systems 1 AI & The Web 1