Ethan Mollick says people take Artificial Analysis scores too seriously
Understand the event
Ethan Mollick said on X that people take the Artificial Analysis Index and its individual scores “way too seriously,” criticizing the weight people place on those ratings.
Generated by AI from reports · Updated 4 days ago
Report timeline
Follow the reports to explore different sides of the event.
- Goodfire’s Nick Cammarata argues agentic analysis resolves familiar examples of neural polysemanticity
Latent Space highlights Goodfire’s Nick Cammarata’s working theory that neural networks are already largely interpretable, with further agentic analysis resolving many familiar examples of polysemanticity and superposition. Cammarata argues that most neurons are legible, contrasting with roughly 2% in his 2023 OpenAI effort. The roundup also reports objections concerning weak activations, neuron simulation and neglected non-maximal activations, alongside a reminder that the paper itself is not yet available.
- 151 Apps, Including WeChat and Taobao, Reject Doubao Phone Assistant GUI Automation
Doubao Phone Assistant says it will gradually open third-party app GUI automation after the 30-day public comment period for its Screen Automation Protocol ends, but only for apps that have not refused. Its published refusal list names 151 apps, including WeChat, DeepSeek, Taobao, Kuaishou, and Meituan. Users can still install, log into, and operate those apps manually on the listed phones.
- How Antai MBA Is Training Future Business Leaders for the AI Era
Shanghai Jiao Tong University Antai College of Economics and Management is reshaping its MBA education to prepare business leaders who can combine technical understanding with business judgment and responsibility. Its “Five Links” talent framework connects AI, science and technology innovation, industry, global perspectives, and Shanghai Jiao Tong University resources. The college also plans to co-create 1,000 AI projects with companies over the next decade and has announced curriculum and training changes for the 2027 cohort.
- Ian Quigley Explains Leash Bio’s Data Methods and Lab-in-the-Loop Agent Research
Brandon Anderson interviews Leash Bio’s Ian Quigley about generating reproducible protein–small molecule interaction data using DNA Encoded Libraries and detecting misleading signals in experiments and models. They discuss a Kaggle competition with about 4B measurements where nobody beat chance on an unseen chemical library, and an agent sandbox searching 6.5M molecules on a budget of 100. Anderson reports that the sandbox has matured into Minos, with a preprint, blog, and open dataset being released today.
- Google ResearchPicksResearch@ 2026: 10 Ways Google Research Is Amplifying Human Ingenuity
Google Research presented 10 updates at Research@ spanning geospatial intelligence, scientific agents, document verification, edge hardware, numerical models, healthcare, disaster forecasting, education, and collaborative prototyping. It is expanding early access to experimental Google Earth AI capabilities and opening Deep Review to the general public after an early version reviewed over 16,000 research publications. Other updates include an upcoming TimesFM and TabFM integration into Gemini for business and an AMIE study involving 98 patients, in which clinicians reported that AI summaries helped them prepare in 75% of cases.
- STEPX launches Neo agent phone with Step AOS 1.0 and Amoo
STEPX unveiled its STEPX Neo early-access edition on October 13, combining Step AOS 1.0, personal agent Amoo, and phone hardware for 3,999 yuan. The phone pairs local execution with cloud-based task planning, while Step Studio lets developers create apps, agents, and Skills using natural language. Buyers receive 12 months of 10 billion tokens per month; the article lists presales for October 13 at 21:00 and general sales for October 16 at 10:13.
- 宝玉 · XPicksGoogle Play adds private installation of AI Studio apps without developer registration
Google announced that users can wirelessly install Android apps created in Google AI Studio on their own devices through Google Play using a regular Google account, without developer registration. The feature begins rolling out today to users 18 and older in selected markets, including the US; apps remain private, with sharing for close friends and family planned over the coming months. Baoyu also reports updates to Ask Play app comparisons, Play in Gemini, and game discovery through Game Finder and Gamer DNA.
- Google Play adds private Android apps built with Google AI Studio
Google announced that users can build personal Android apps with Google AI Studio and run them privately through Google Play using a standard Google account. The apps remain accessible only to their creators, must comply with existing Play policies, and will initially be available to U.S. users age 18 and up. Google says sharing with trusted friends will follow in the months ahead, with a path to public publication after trust and safety reviews.
- Shing-Tung Yau launches Chinese AI mathematics alliance amid Western skepticism
Shing-Tung Yau and leading Chinese mathematicians launched the Yau Laboratory Alliance for Mathematics and Artificial Intelligence on Sunday in Beijing, according to the South China Morning Post. It unites eight institutions and aims to connect over 1,000 researchers, with plans for specialized models, machine-verifiable proofs, and transparent AI reasoning. Meanwhile, 25 Fields Medal winners, including Terence Tao and Peter Scholze, worry that AI-generated proofs erode mathematical understanding and encourage dependence on tools researchers cannot follow.
- Latent SpacePicksMeta launches Muse Wonder and Muse Wonder Full frontier models
Meta Superintelligence Labs released Muse Wonder and Muse Wonder Full, its second-generation model family for personal and professional agentic work. Latent Space reports that Wonder is available through the Meta Model API and Muse Code, while Full is limited to Muse Code subscribers. Artificial Analysis gives Wonder Full and Wonder Intelligence Index v4.3 scores of 56 and 52, respectively, versus Opus 5.5’s 58; Wonder supports a 1M context window and text, image, video, and audio inputs, with text-only output.
- NVIDIA Announces Planned Investments in Four French Startups
NVIDIA announced planned investments in Doctolib, Entalpic, Genesis AI and Pigment, which are working across healthcare, materials discovery, physical AI and business planning. The announcement adds to NVIDIA’s previous investments in French technology companies Alice&Bob, Gradium and Scintil Photonics. Across Europe, NVIDIA has committed nearly $10 billion to the technology ecosystem.
- People take the Artificial Analysis Index and its individual scores way too seriously.
People take the Artificial Analysis Index and its individual scores way too seriously.
Keep reading
Latest daily · Issue 24NVIDIA and AI4Bharat Introduce Nemotron-pretraining-Indic-v1 and an Open Data Generation PipelineTrending now
- 1Meta Releases Muse Spark Open With Mac and Cloud Support, Topping US Open-Weight Index
- 2Google Launches Gemini 4 Argon Globally, Expands Paid Access as Benchmark Results Vary
- 3OpenAI Updates GPT-6 Astra Pro in ChatGPT With Parallel Agents and Faster Responses
- 4Meta’s New Business Terms Raise Dispute Over Website Crawling and AI Training Rights