Hugging Face uses agents to reproduce more than 2,200 ICML papers
Hugging Face ran the ICML 2026 Open Reproduction Challenge from July 15 to August 2. A community of 1,221 used coding agents such as Claude Code, Codex, and Cursor to reproduce papers, publishing 6,816 Trackio logbooks covering 2,226 papers—about 34% of all papers at the conference.
Why it matters: Hugging Face has published reproduction results and adjudication data for more than 2,200 ICML papers, offering a view of the limits of agents in scientific reproduction.
