Tagged open-weight models · show all articles
A released checkpoint is usually described as an endpoint. It is closer to a beginning — ten separately documented failures, from safety training stripped in weeks to weights carrying a hidden payload, show what actually happens once the download starts.
Two questions decide how open-weight AI matures by 2035: whether it closes the capability gap with closed frontier models, and whether regulators and license terms converge on treating it like closed deployment. Four scenarios, each with a falsifier.
Meta's own papers specify exactly how Llama encodes position, shares attention across heads, gates its activations and normalizes its signals — and exactly what changed, and did not change, from Llama 2 through Llama 3 to Llama 4.
A permissive-sounding grant still carries a usage threshold, a use policy and a naming rule. What checkpoint you start from, how you adapt it and what you can prove about the result decide what actually ships.
Two variables decide the frontier-model contest by 2035: how many labs stay near the frontier, and whether the public signal of leadership is benchmark score or deployment outcome. Four scenarios follow, each with a falsifier.
Meta, Mistral, and a growing field of well-funded challengers are shipping open-weight models within a few months of closed frontier releases, changing the calculus for enterprises deciding whether to build or rent.