#hybrid inference

Tagged hybrid inference · show all articles

A slotted aluminium device-fleet rack of phones and tablets mostly cabled and seated, one phone's bay still open with its USB-C lead hanging free, beside a release desk where a label applicator arm is mid-stroke onto a foil model-package bag

Shipping an On-Device AI Feature That Actually Works in the Field

A model that answers correctly on the phone sitting on an engineer's desk has cleared the lowest bar in the project. Compression, cloud fallback, fleet testing, versioning and privacy claims are each a decision — made well on purpose, or made badly by default.

By Brecht Corbeel · August 12, 2026 · 15 min read

Browse by Category

Surprise me →

All AI Hardware & Semiconductors 100 AI Agents & Systems 33 Foundation Models 27 Model Evaluation 15 AI Industry 9 Edge AI & Electronics 7 AI Safety 7 AI Research 7 Open Models 6 AI Infrastructure 5 Industry Analysis 2 Datacenters & Infrastructure 2 Writing & Information 1 Structural Biology 1 Small & Edge Models 1 Semiconductor Markets 1 Security & Technology 1 Security 1 Scientific Revolution 1 Robotics & Embodied AI 1 Quantum Information 1 Planetary Science 1 Physics 1 Particle Physics 1 Origins & Astrobiology 1 Open-Weight Models 1 Neuroscience 1 Metrology 1 Mathematics & Computation 1 Materials Science 1 Labour & Technology 1 Interpretability 1 Institutions & State Capacity 1 Institutions & Economy 1 Inference Economics 1 Industrial Revolutions 1 Humanity & Technology 1 History of Technology 1 History of Computing 1 Governance & Policy 1 Evolution & Ecology 1 Ethics of Technology 1 Energy & Civilization 1 Earth & Climate 1 Demography & Urbanization 1 Data & Training 1 Cumulative Culture 1 Cosmology 1 Condensed Matter 1 Chemistry & Catalysis 1 Alignment & Safety 1 Agriculture & Cities 1 Agent Evaluation 1 AI Security 1 AI & The Web 1