9.6K views · 242 likes · 17 reposts (at collection)
Chollet compares Gemini 4 Argon’s ARC-AGI-3 performance with Astra
- Who
- François Chollet
- What
- commented that Argon has a similar performance profile to Astra Gemini 4 Argon’s ARC-AGI-3 performance
What happened
Argon has a similar performance profile on ARC-AGI-3 as Astra, François Chollet says, adding that Google is back at the frontier. The quoted ARC Prize post reports Gemini 4 Argon’s verified ARC-AGI-3 results of 97.5%, $4.8K with a provider adapter harness and 49.8%, $5.8K with the standard harness, plus 91.3%, $0.32/task on ARC-AGI-2 and 98.5%, $0.16/task on ARC-AGI-1.
Links in the post: 2Why it matters
The reported ARC-AGI-3 scores distinguish provider adapter and standard harness results, providing context for Chollet’s comparison of Argon with Astra and his assessment of Google’s frontier position.
The story so far
Google launched Gemini 4 Argon globally through paid developer services and subscriptions, with access expanding to Antigravity Pro users, Cursor and Perplexity. Sundar Pichai announced availability through the paid Gemini API and Gemini platform, for Pro and Ultra subscribers in the Gemini app and Search, and for Ultra subscribers in Antigravity. Baoyu reported that Antigravity added paid Pro subscribers through its desktop app, CLI and IDE extensions, with a separate weekly quota; that expansion excludes Antigravity IDE, Pro trials, free users and Plus subscribers. Perplexity announced access for Pro and Max subscribers, while CEO Aravind Srinivas said all Perplexity users could access Argon in fast search and Computer agent modes. API pricing is $2 per million input tokens and $10 per million output tokens through November 30, rising to $4 and $20 on December 1. Artificial Analysis found that Argon matched GPT-6 Astra on its Intelligence Index at 60% of Astra’s cost per task under introductory pricing. Epoch AI scored Argon at 165, tied with Fable 5.1 but behind Astra at 166 and Opus 5.5 at 167. The Decoder reported ARC-AGI-3 scores of 97.5% with the Provider Adapter Harness and 49.8% at low reasoning with the Standard Harness, where API problems prevented completion of all games. Google’s Gemini App account also said Argon can use Canvas to turn dense PDFs into interactive, animated web apps.
Keep reading
Latest daily · Issue 24NVIDIA and AI4Bharat Introduce Nemotron-pretraining-Indic-v1 and an Open Data Generation PipelineTrending now
- 1Meta Releases Muse Spark Open With Mac and Cloud Support, Topping US Open-Weight Index
- 3OpenAI Updates GPT-6 Astra Pro in ChatGPT With Parallel Agents and Faster Responses
- 4Meta’s New Business Terms Raise Dispute Over Website Crawling and AI Training Rights
- 5Reflection Releases Beam Open Weights Model With Launch-Day vLLM Support