UniPat AI releases PaperBenchX: GPT-6 Astra fully reproduces only 13.98% of papers
ChatGPT踢到铁板了！能破解千禧数学难题，但论文复现率低至13.98%？
What happened
UniPat AI released PaperBenchX, described as the first end-to-end, multidisciplinary benchmark for reproducing paper results. It builds 93 reproduction tasks from 93 papers, spanning 12 research areas including electromagnetics, photonics, chemistry, materials, biology, and robotics, across 10 field-native scientific environments, with 3,168 expert-verified scoring criteria.
OpenAI / ChatGPTAgentsOpen sourcePapers and researchBenchmarks#Benchmarks#Research#Agent#Open-source ecosystem#OpenAI
Keep reading
Latest daily · Issue 24NVIDIA and AI4Bharat Introduce Nemotron-pretraining-Indic-v1 and an Open Data Generation PipelineTrending now
- 1Meta Releases Muse Spark Open With Mac and Cloud Support, Topping US Open-Weight Index
- 2Google Launches Gemini 4 Argon Globally, Expands Paid Access as Benchmark Results Vary
- 3OpenAI Updates GPT-6 Astra Pro in ChatGPT With Parallel Agents and Faster Responses
- 4Meta’s New Business Terms Raise Dispute Over Website Crawling and AI Training Rights
Tomorrow at 08:00, a briefing like this arrives in your inbox.
The same kind of briefing as the one above: a few stories worth reading. Free. Mail starts after you confirm, and every letter has a one-click unsubscribe. Read a past issue · 2026-10-17