#benchmark evaluation

Tagged benchmark evaluation · show all articles

A wall of pressboard incident case-cards in steel spring clips, each pairing a small printed image thumbnail with a transcript excerpt, with one card lifted part-way clear of its clip and still catching on the spring

Ten Failure Modes That Define Multimodal AI Systems

A model that sees, hears and reads still returns one fluent answer, and fluency hides the fact that the link between that answer and what was actually there breaks in ten distinct, independently documented ways.

By Brecht Corbeel · August 12, 2026 · 16 min read

A bright competitive-intelligence research room with a long walnut capability-tracking bench in the foreground, a small frosted-acrylic puck caught mid-slide along its calibrated brass rail, and a brushed-steel market-positioning wall with four clusters of magnet-held cards beyond it

Model Evaluation

The Frontier Model Landscape in 2035: Four Scenarios, Their Signals, and What Would Falsify Them

Two variables decide the frontier-model contest by 2035: how many labs stay near the frontier, and whether the public signal of leadership is benchmark score or deployment outcome. Four scenarios follow, each with a falsifier.

By Brecht Corbeel · August 12, 2026 · 20 min read

Browse by Category

Surprise me →

All AI Hardware & Semiconductors 100 AI Agents & Systems 33 Foundation Models 27 Model Evaluation 15 AI Industry 9 Edge AI & Electronics 7 AI Safety 7 AI Research 7 Open Models 6 AI Infrastructure 5 Industry Analysis 2 Datacenters & Infrastructure 2 Writing & Information 1 Structural Biology 1 Small & Edge Models 1 Semiconductor Markets 1 Security & Technology 1 Security 1 Scientific Revolution 1 Robotics & Embodied AI 1 Quantum Information 1 Planetary Science 1 Physics 1 Particle Physics 1 Origins & Astrobiology 1 Open-Weight Models 1 Neuroscience 1 Metrology 1 Mathematics & Computation 1 Materials Science 1 Labour & Technology 1 Interpretability 1 Institutions & State Capacity 1 Institutions & Economy 1 Inference Economics 1 Industrial Revolutions 1 Humanity & Technology 1 History of Technology 1 History of Computing 1 Governance & Policy 1 Evolution & Ecology 1 Ethics of Technology 1 Energy & Civilization 1 Earth & Climate 1 Demography & Urbanization 1 Data & Training 1 Cumulative Culture 1 Cosmology 1 Condensed Matter 1 Chemistry & Catalysis 1 Alignment & Safety 1 Agriculture & Cities 1 Agent Evaluation 1 AI Security 1 AI & The Web 1