Research papers, technical reports, benchmarks and datasets.
Import AI 476 covers Humanity’s Sixth Sense, a benchmark from Elorian and Scale AI that tests intuitive visual reasoning. People scored 93.1 aggregate pass@1, while GPT 6 Astra scored 53.6; GLM-5.3-flash and Kimi K3 scored 26.8 and 25.5. The newsletter also examines how AI could accelerate space development and reports on TasteVal, a benchmark of AI systems’ research taste.
WorldArena 2.0 Challenge, run by a Tsinghua-led team, released its final leaderboard on September 16 with three tracks covering video quality, world models as reinforcement learning environments, and real-robot manipulation. Visincept's WorldIncept won Track 1, Zhongguancun Academy's MW2 won Track 2, and Xiaomi Robotics' ViTacX topped Track 3, with total prize money of 7,000 USD. Organizers said contact-rich real-robot operation remains a bottleneck.
OpenAI published 722 manuscripts across 372 result families. According to the newly formed independent advisory group AGMAI, the collection includes answers to hundreds of open problems, produced by an unreleased frontier model.
Why it matters: OpenAI released 722 mathematical manuscripts at once, giving readers a view of the work's scale, publication method, and debate over research ethics.
The UK's AI Security Institute (AISI) is adopting EvalEval's Every Eval Ever schema and Evaluation Cards platform to share evaluation results publicly and improve reproducibility in evaluation science.
Hugging Face ran the ICML 2026 Open Reproduction Challenge from July 15 to August 2. A community of 1,221 used coding agents such as Claude Code, Codex, and Cursor to reproduce papers, publishing 6,816 Trackio logbooks covering 2,226 papers—about 34% of all papers at the conference.
Why it matters: Hugging Face has published reproduction results and adjudication data for more than 2,200 ICML papers, offering a view of the limits of agents in scientific reproduction.
