A new model released this week on r/LocalLLaMA deserves our attention: Ornith-1.5. The 397B parameter version scored 86 on SWE-Bench Verified, and its makers claim it matches Claude Opus 4.8 overall. We see this as the first time an open-source model has reached the edge of the closed-source frontier on agent (AI's ability to autonomously execute tasks) and coding tasks.

What This Is

Ornith-1.5 is a newly released family of open-source large models in three sizes covering different deployment needs: 9B Dense (compact), 35B MoE, and 397B MoE (whose coding-focused sub-version is called DeepSWE 56).

(Quick definition: MoE stands for Mixture of Experts—a hybrid-expert architecture that retains a large total parameter count while activating only a fraction per inference, keeping compute costs in check.)

Officially released core benchmarks:

  • Terminal-Bench 2.1: 86.1
  • SWE-Bench Verified: 86
  • SWE-Bench Pro: 65.1
  • DeepSWE: 56
  • HLE: 44.6
  • ClawEval: 81.4
  • Tool Decathlon: 71.2

Training emphasizes a "self-improving" approach—models generate their own training data and pose problems to themselves during training.

Industry View

Optimists view this as open source's turning point: while DeepSeek, Qwen, and Llama have largely aimed at "GPT-4-class performance," Ornith-1.5 raises the bar directly to Claude Opus 4.8—the current top tier. If the claim holds, enterprises no longer need to pay Anthropic or OpenAI for top-tier AI capability.

But the editorial team also has three reservations.

First, benchmark scores do not equal real-world engineering capability. SWE-Bench is an offline test drawn from real GitHub issues; running an Agent against an enterprise's internal systems is a different matter entirely.

Second, the publisher's identity and reproducibility are uncertain. The Reddit submitter "KokaOP" has an unclear relationship to the project, and public successful reproductions of "self-improving" training remain scarce.

Third, the deployment barrier. Even with sparse activation, 397B won't fit on a single GPU; the actually self-deployable 9B version's scores on these benchmarks have not been disclosed separately.

Impact on Regular People

For enterprise IT procurement: Over the next 6-12 months, open-source models may for the first time offer a viable path to replacing part of a Claude subscription in coding and agent scenarios. In our view, worth a technical team running an internal POC (proof of concept).

For working professionals: If you currently use Cursor or Claude Code, no need to switch yet. But for companies sensitive to data egress, smaller open-source models like 9B are starting to offer a real "run locally" option.

For the consumer market: No near-term change. Consumer users experience ChatGPT, Doubao, and Tongyi Qianwen at the application layer; open-source gains at the infrastructure layer won't immediately translate into better app experiences.