#feature splitting

Tagged feature splitting · show all articles

A rack of accelerator boards standing in for successive model layers, dense jumper leads linking neighbouring boards, one long lead stretched from an early board toward a distant one with its clip not yet closed

The Hardest Unsolved Problems in Mechanistic Interpretability

Sparse autoencoders were meant to finish what superposition started. By the field's own papers, five problems remain open: unstable feature geometry, no ground truth, arbitrary dictionaries, and no agreed bar for a finished explanation.

By Brecht Corbeel · August 23, 2026 · 15 min read

Browse by Category

Surprise me →

All AI Hardware & Semiconductors 100 AI Agents & Systems 38 Foundation Models 30 Model Evaluation 19 AI Industry 12 Edge AI & Electronics 9 AI Safety 9 AI Research 9 Open Models 8 AI Infrastructure 8 Industry Analysis 2 Datacenters & Infrastructure 2 Writing & Information 1 Structural Biology 1 Small & Edge Models 1 Semiconductor Markets 1 Security & Technology 1 Security 1 Scientific Revolution 1 Robotics & Embodied AI 1 Quantum Information 1 Planetary Science 1 Physics 1 Particle Physics 1 Origins & Astrobiology 1 Open-Weight Models 1 Neuroscience 1 Metrology 1 Mathematics & Computation 1 Materials Science 1 Labour & Technology 1 Interpretability 1 Institutions & State Capacity 1 Institutions & Economy 1 Inference Economics 1 Industrial Revolutions 1 Humanity & Technology 1 History of Technology 1 History of Computing 1 Governance & Policy 1 Evolution & Ecology 1 Ethics of Technology 1 Energy & Civilization 1 Earth & Climate 1 Demography & Urbanization 1 Data & Training 1 Cumulative Culture 1 Cosmology 1 Condensed Matter 1 Chemistry & Catalysis 1 Alignment & Safety 1 Agriculture & Cities 1 Agent Evaluation 1 AI Security 1 AI Economics & Systems 1 AI & The Web 1