Skip to content

Artificial Analysis Launches FrontierCode 1.1 Leaderboard for Maintainer-Ready Coding Changes

2 reports 2 reporting sources 4 days agoNew

Understand the event

AI overview

Artificial Analysis launched a FrontierCode 1.1 leaderboard, with Claude Opus 5.5 (max with fallback) leading at 52% and MiMo-V2.6-Pro leading open-weights models at 45%. GPT-6.1 Sol (max) scored 49% at $0.81 per task, matching the score of Claude Fable 5.1 (max with fallback). The leaderboard uses the 100-task Main set from Cognition’s private coding benchmark and the Stirrup open-source reference harness. Artificial Analysis said the benchmark tests whether models can complete coding tasks in a way that maintainers of real-world repositories would accept for merging. Grading combines unit tests with maintainer-oriented criteria, and failing any blocking check gives an attempt a score of zero. Claude Opus 5.5 passed those blocking checks in 58% of attempts.

Generated by AI from reports · Updated 4 days ago

Report timeline

Follow the reports to explore different sides of the event.

10/13
  1. Meta launches Muse Wonder and Muse Wonder Full frontier models

    Meta Superintelligence Labs released Muse Wonder and Muse Wonder Full, its second-generation model family for personal and professional agentic work. Latent Space reports that Wonder is available through the Meta Model API and Muse Code, while Full is limited to Muse Code subscribers. Artificial Analysis gives Wonder Full and Wonder Intelligence Index v4.3 scores of 56 and 52, respectively, versus Opus 5.5’s 58; Wonder supports a 1M context window and text, image, video, and audio inputs, with text-only output.

  2. Artificial Analysis launches FrontierCode 1.1 leaderboard measuring maintainer-ready coding changes

    Artificial Analysis launched its FrontierCode 1.1 leaderboard, evaluating models on Cognition’s private coding benchmark using the 100-task Main set and its Stirrup open source reference harness. Grading combines unit tests with maintainer-oriented criteria; failing any blocking check yields zero. Claude Opus 5.5 (max with fallback) leads at 52%, with blockers passed in 58% of attempts; MiMo-V2.6-Pro leads open weights models at 45%, while GPT-6.1 Sol (max) scores 49% at $0.81 per task, matching Claude Fable 5.1 (max with fallback).

Keep reading

Latest daily · Issue 24NVIDIA and AI4Bharat Introduce Nemotron-pretraining-Indic-v1 and an Open Data Generation Pipeline

Trending now

  1. 1Meta Releases Muse Spark Open With Mac and Cloud Support, Topping US Open-Weight Index
  2. 2Google Launches Gemini 4 Argon Globally, Expands Paid Access as Benchmark Results Vary
  3. 3OpenAI Updates GPT-6 Astra Pro in ChatGPT With Parallel Agents and Faster Responses
  4. 4Meta’s New Business Terms Raise Dispute Over Website Crawling and AI Training Rights