Skip to content
All news · Today1 items

#Data and training

All collected and published items, ordered by time. Picks are a selected subset.
Opinion

Viewpoints, commentary, analysis, interviews, and discussion of trends.

Today10/17Sat
  1. MIT Technology Review · AI44

    MIT Technology Review’s James O’Donnell Interviews AI-Designed Virus Creator Samuel King

    Senior AI reporter James O’Donnell interviews Stanford University bioengineering PhD candidate Samuel King about using a generative AI model to propose genetic blueprints for microscopic viruses. The session covers King’s work, his recognition as one of MIT Technology Review’s Innovators Under 35, and new ways of seeing biology. The source says this is not yet an example of AI-generated life.

10/16Fri
  1. Mira Murati · X53

    Mira Murati reflects on Tinker users turning their ideas into model weights they own

    Mira Murati says one of the best parts of this year, inside Thinky and out, has been watching people follow their own ideas into weights they own. https://twitter.com/thinkymachines/status/2110851669915570685 In the quoted post, @thinkymachines marks one year since Tinker’s launch with a look back at what it has shipped and what users are building. https://thinkingmachines.ai/news/one-year-of-tinker/

  2. 量子位57

    Former Huawei Xiaoyi model lead Tang Duyu founds startup pursuing proactive physical AI

    Tang Duyu, former head of multimodal model development for Huawei’s Xiaoyi assistant, founded Guanxing Shuzhi to develop physical AI that identifies needs and decides when to intervene without explicit commands. Its ProAgent architecture pairs StreamingJev, a lightweight event monitor, with a Response Model that plans interventions and selects devices. The team reports testing guidance, warnings, and interaction on Reachy Mini across 60 cases, and introduced ProactiveXBench to evaluate intervention timing, progress, and outcomes.

10/15Thu
  1. Latent Space67

    Ian Quigley Explains Leash Bio’s Data Methods and Lab-in-the-Loop Agent Research

    Brandon Anderson interviews Leash Bio’s Ian Quigley about generating reproducible protein–small molecule interaction data using DNA Encoded Libraries and detecting misleading signals in experiments and models. They discuss a Kaggle competition with about 4B measurements where nobody beat chance on an unseen chemical library, and an agent sandbox searching 6.5M molecules on a budget of 100. Anderson reports that the sandbox has matured into Minos, with a preprint, blog, and open dataset being released today.

10/14Wed
  1. François Chollet · X31

    The ideal outcome for science isn't a couple of labs using proprietary models and millions of dollars to crack trophy problems, it's to have millions of AI-aided human scientists who follow their curiosity and become way more ambitious

    The ideal outcome for science isn't a couple of labs using proprietary models and millions of dollars to crack trophy problems, it's to have millions of AI-aided human scientists who follow their curiosity and become way more ambitious

10/13Tue
10/11Sun
  1. The Decoder40

    Cheaper AI tokens are driving more demand, and that's Jensen Huang's best-case scenario

    Data from Ornn, Silicon Data, and Bloomberg as of August 2026 shows what a16z calls a textbook Jevons paradox in the AI market: token prices keep dropping while H100 GPU rental prices hold steady or climb. Cheaper tokens unlock AI agents, automation, and new applications, so volume grows faster than per-unit costs fall. The system depends on AI usage growing fast enough to offset falling token prices; if demand flattens, chip makers, memory suppliers, energy providers, and cloud companies take a hit.

  2. Nathan Lambert · X33

    Nathan Lambert Sees Investment in RL Data and Real-World Evaluations

    Nathan Lambert says the data industry has grown, but low-quality output can amplify behaviors such as reward hacking. He is advising Mercor on research into sample-efficient data for RL and says the field needs stronger evaluation science and benchmarks tied to areas of clear economic value. Lambert expects major investment around frontier labs in open inference, open post-training and data, with opportunities to build on open models.

10/10Sat
  1. 雷锋网28

    IROS 2026 keynote: more data does not mean better robot decisions

    At IROS 2026, University of Queensland researcher Jen Jen Chung argued in a keynote that data volume is not the same as information, and that blindly piling up data can degrade robot policies. Drawing on drone soaring, multi-robot communication and contact-rich assembly work, she said data value is unevenly distributed and that sharing or collecting only decision-changing information beats full broadcasts or uniform sampling.

  2. 雷锋网36

    IROS 2026 Signals Embodied AI's Shift From Concepts to Engineering

    At IROS 2026, running September 27 to October 1 in Pittsburgh, Leiphone reports embodied AI research is converging on four trends: foundation models internalizing physics, "brain-cerebellum" architectures becoming standard, touch as core to dexterous manipulation, and cheaper data collection. Papers cited include ULTRA, LITHE, VOFA, KineFuse, VTAP Gripper, ViHaTeleop, and HALO, alongside workshops on physical world models and uncertainty.

10/9Fri
  1. Latent Space36

    Periodic Labs' Liam Fedus and Ekin Dogus Cubuk on "synthesis superintelligence": from semiconductors to superconductors

    In an interview, Periodic Labs' Liam Fedus and Ekin Dogus Cubuk proposed a "synthesis superintelligence" approach: reinforcement learning in physical experiments, AI-driven materials characterization, density functional theory (DFT), and high-throughput labs. The aim is for models to learn the full process of doing science, rather than only studying published results.

10/8Thu
  1. 雷锋网32

    Dialogue with ONTIME Mobility COO Han Feng: The stronger the world model, the more real data becomes the true moat

    ONTIME Mobility COO Han Feng believes that as world model capabilities grow stronger, the importance of real data will not diminish: synthetic data is responsible for expanding known long-tail scenarios, while real data is responsible for discovering unknown problems and providing calibration and validation. ONTIME Mobility does not train large models; instead, it collects real data through routine mobility services, Robotaxi, and offline operations and maintenance networks, and delivers training materials to autonomous driving, world model, and embodied intelligence companies through a data closed loop.

10/6Tue
10/5Mon
  1. MIT Technology Review · AI12

    How to bring predictive analytics into the age of agentic AI

    The focus of enterprise AI competition has shifted from whether predictive models can outperform statistical forecasts to how prediction systems can make autonomous decisions without straying from business intent. Deep learning and generative AI enable real-time training, allowing AI to keep evolving rather than wait for quarterly refreshes, and expand its data sources from structured numerical records to unstructured interaction data. Vishal Gupta, a partner at Everest Group, says the word 'analytics' is giving way to AI.

9/30Wed
  1. 雷锋网40

    Why do Kimi and DeepSeek appear in the same model-architecture diagram?

    Of the 45 layers in GLM-5.3-Flash, 34 use Kimi's KDA linear-attention approach and 11 use DeepSeek's KPool-DSA sparse attention. Linear and Sparse attention appear together in one model for the first time. The combination reflects a shift away from finding a single best mechanism toward assigning different roles: Linear maintains long histories at low cost, while Sparse retrieves specific information as needed.

  2. 雷锋网28

    From 3D vision to world models: why spatial intelligence is a common thread in AI's move into the physical world | ECCV 2026 recap

    ECCV 2026 received 10,473 submissions and accepted 2,834. The 3D topic fell from a leading area to third place, but questions around 3D representation, geometry, and physical consistency are spreading into video generation, embodied AI, and world models. Of 93 workshops, about 10 were directly related to 3D, 11 to spatial intelligence, nine to physical AI, and five to world models. Best-paper and honorable-mention awards also focused on 3D surface representation, object reconstruction, and geometry perception.

9/24Thu
  1. Latent Space36

    Foundries vs. Navigators: how AI can lower the cost of scientific research

    Language models have greatly sped up coding and data analysis, but the bottleneck in scientific research remains physical experiments that can take days or weeks to validate: “thinking got cheaper; doing didn't.” The biotech industry is splitting into two approaches. Foundries use next-generation sequencing, multiplex assays, and lab automation to produce experimental data an order of magnitude faster; Navigators embed AI in day-to-day company workflows to accelerate decisions.

9/23Wed
9/12Sat
  1. Thinking Machines · X34

    Thinking Machines' John Schulman discusses where human judgment still matters as models self-improve

    Our own @johnschulman2 talks with Dwarkesh about where human judgment still matters as models improve and self-improve: teaching them to handle messy real-world tasks, applying taste to what works in the long run, and, above all, specifying what we actually want. Quoted post by @dwarkesh_sp (context, not the main author's work): New episode with @johnschulman2, @oneill_c and @BerenMillidge. I got together with some of the most insightful AI researchers I know who are at the openish companies, because I wanted to hear the details of what's actually happening at the frontier and what comes next. 0:00:00 – Steelmanning the case against RSI 0:18:39 – What's driving the Chinese labs' progress 0:28:06 – How will automated AI researchers be trained 0:33:51 – Will long-horizon RL elicit AGI? 0:45:24 – The sim-to-real gap 1:00:33 – How much progress is explained by data? 1:18:03 – Why is RL working so well? 1:24:54 – Move 37 and entropy collapse 1:28:31 – Rapid-fire timelines

9/11Fri
  1. John Schulman · X44

    John Schulman Says User Data Likely Plays a Limited Role in Frontier Model Gains

    John Schulman says training on user data is exceedingly unlikely to contribute much to frontier models’ math gains, which he attributes to scaling pretraining and RLVR. He says user data may instead help identify failure modes that hired annotators cannot easily recreate, and calls for stronger disclosure norms about how companies train on user data and what capabilities they aim to improve.

8/20Thu
  1. Jim Fan · X54

    Jim Fan analyzes repetition, recovery, and UMI in GEN-1.5

    Jim Fan attributes GEN-1.5’s promise to naturally repetitive human demonstrations, retained failures that teach recovery, and UMI, which lets humans collect data directly while wearing a robot gripper. He argues that teleoperation loses physical intuition and that sufficient data can enable zero-shot behaviors such as picking up novel objects without finetuning. He remains cautiously optimistic, noting that in-context learning depends on the distance between training and test conditions and that current demos are too simple to draw conclusions.

8/14Fri
  1. Hugging Face Blog62

    Hugging Face releases 2026 summer report on the open-model ecosystem

    Hugging Face has released a report on the open-model ecosystem from January through August 2026, drawing six findings from Hub data. Public model repositories grew from 2.43 million to 2.96 million and datasets from 711,000 to one million, but 85.6% of models have fewer than 200 lifetime downloads, while 1.5% of repositories account for 99.2% of downloads.

    Why it matters: Hugging Face analyzes its Hub data on the open-model ecosystem; findings on downloads versus likes and the scale of Qwen derivatives can inform model selection.

7/30Thu
  1. Hugging Face Blog22

    GPU management: why idle GPUs are becoming the new grounded airplanes

    A Hugging Face blog argues that GPU utilization, not model intelligence, is AI's next real constraint. GPU costs accrue by calendar hours, but output is produced only during compute hours; after buying GPUs, companies face the challenge of keeping their clusters busy. Using aviation as an analogy, the article says even fully loaded clusters may waste much of their potential because GPUs run all day while demand does not.

7/7Tue
  1. Berkeley AI Research40

    What happens when intelligence becomes cheap? Data systems for agents, operated by agents, and built by agents

    Berkeley's EPIC Data Lab argues that as inference costs have fallen from around $30 per million tokens for GPT-4-level models in early 2023 to under $1 today—and below $0.10 at some vendors—data systems face three new challenges: systems designed for agents, systems operated by agents, and systems built by agents.

5/18Mon
5/4Mon