What happened
GPT-6.2 Astra sets a new high on Agents’ Last Exam, scoring 5.2 points higher than GPT-6 Astra at less than one-third the cost per task. The benchmark tests complex multistep professional work, including campaign analysis, slide creation, and financial spreadsheet building.
The same story is shown in the picks as 《OpenAI Introduces GPT-6.2 Astra and Sol》
GPT-6.2 Astra sets a new high on Agents’ Last Exam, scoring 5.2 points higher than GPT-6 Astra at less than one-third the cost per task.
The benchmark tests complex multistep professional work like analyzing campaigns, creating slides, and building financial spreadsheets.
Reported by 8 sources
The story so far
OpenAI released the GPT-6.2 Astra and Sol models, which are available now in ChatGPT Work, Codex, and the API. Astra, positioned as the company’s new flagship model, offers reduced pricing with API rates 20% lower than its predecessor at $8 per million input tokens and $40 per million output tokens, while Sol maintains the existing $2 and $10 pricing structure. OpenAI also expanded access to its Ultrafast mode to include Pro 200 and Pro 500 subscription tiers. The company reports that GPT-6.2 Astra sets new highs on benchmarks including Agents' Last Exam, BenchCAD 2.1, and Terminal-Bench Science 0.1 at lower task costs. However, external evaluations show mixed results. Epoch AI reported that GPT-6.2 Astra scored 65% on internal automation quality standards, trailing Fable 5.2. Additionally, independent testing by Simon Willison indicated that the model struggled with animation tasks compared to other frontier models. OpenAI also implemented tighter cybersecurity safeguards for the new models and plans to provide access through its Daybreak platform for approved defenders, though the company noted that these safeguards may increase refusal rates for some security research tasks.
How the story developed · 4
View full event- 11/18 06:15 (UTC+8)Tibor Blaho Tests GPT-6.2 Astra and Sol on Daily WorkTibor Blaho · X
- 11/18 06:15 (UTC+8)Perplexity Shares GPT-6.2 Astra and Sol WANDR EvalsAravind Srinivas · X
- 11/18 02:36 (UTC+8)OpenAI Introduces GPT-6.2 Astra and SolOpenAI News
- 11/18 02:12 (UTC+8)
GPT-6.2 Astra Sets a New High on Agents’ Last Exam This report
