September 22

The Open-Weight Gap Mozilla Measured, and Why the Money Lags

The best open model is 5 points behind the closed frontier on Epoch's index. Mozilla's report is mostly about what that small number does and does not buy. 📄

The gap is small and it resets

Kimi K3 scores 157 against 162 for Claude Fable 5 and Claude Opus 5, and Epoch converts its average gap of 8 points into about four months. Nothing accumulates. Every model on the chart shipped between June and August, so each release cycle redraws the margin from scratch rather than adding to a running total. In August 8 of the 10 most-used models on OpenRouter were open weights, 7 of them Chinese-built.

The money is old and small

In the May to September 2025 window on OpenRouter, open models carried about 20% of model-layer usage and took about 4% of the revenue, with closed models charging about 6x more per call at roughly 90% capability parity.

OpenRouter, May-September 2025, model layer
usage      open ~20%    closed ~80%
revenue    open ~4%     closed ~96%

That split is the last one published, and the report says usage has moved since.

Where deployments stop

79% of surveyed developers use open models, but 51% of open deployments reach production against 63% for closed, and the survey traces the gap to operational tooling and trust, with capability already clearing the bar. 🔧

Gains from post-training

DeepSeek's July 31 post-training pass added 10 points to V4-Flash on the Artificial Analysis index with the architecture unchanged, and the August 13 pass added 8 to V4-Pro. Neither involved a new pretraining run, which the report reads as a shorter shelf life for its own tables.

Limits

OpenRouter measures routed traffic only, and the gap itself may be understated, since open models optimize harder for benchmarks and unpublished closed models are absent from the baseline.

https://stateofopensource.ai

Follow me for more on AI and Software Development:
khasky — LinkedIn / GitHub / Patreon / Bluesky / Mastodon / Medium / Devto
khaskydev — X / Threads / Instagram / Pinterest / Tumblr / Facebook / VK