Skip to content

Data and training

The training side: building datasets, synthetic data, pre- and post-training methods, compute and training cost.

48 picksLast 30 days 19 itemsCollected 227 items

New

Picks archive · page 3

5/20Wed
5/19Tue
  1. Google DeepMind60

    Google DeepMind's Co-Scientist accelerates discovery of genetic clues to reversing cellular aging

    Google DeepMind biologists Omar Abudayyeh and Jonathan Gootenberg used Co-Scientist to support aging research. After scanning tens of thousands of papers, the tool proposed more than 20 new candidate genetic factors. Lab tests validated several hypotheses, successfully making cells younger and improving their overall function. Co-Scientist also analyzed large-scale genetic-screening data, reducing data and literature linkage work that could take up to six months to just days.

    Why it matters: The source reports specific outputs and time comparisons from Co-Scientist's role in aging research, showing how AI agents contribute to scientific hypothesis generation.

4/30Thu
  1. Google Research62

    Four ways scientists are using Google's Empirical Research Assistance

    Google Research summarizes four areas where scientists use Empirical Research Assistance (ERA): in public health, the team submits weekly influenza forecasts for U.S. states.

    Why it matters: Google uses four real research projects to show ERA deployments in epidemic forecasting, cosmology, carbon monitoring, and neuroscience, illustrating how AI-assisted research is being used.

4/22Wed
  1. Google DeepMind62

    Google DeepMind releases Decoupled DiLoCo distributed-training architecture

    Google DeepMind has released Decoupled DiLoCo, a distributed-training architecture that divides large-scale training into compute islands communicating asynchronously, reducing bandwidth requirements and isolating hardware failures. In tests, training continued and reconnected after an entire learner unit went offline, achieving the same ML performance as traditional methods with Gemma 4 models.

    Why it matters: The source reports distributed pretraining results across bandwidth, fault tolerance, and mixed-generation hardware, helping readers assess engineering tradeoffs.

3/18Wed
  1. Mistral AI62

    Mistral AI launches Forge, an enterprise model-training system

    Mistral AI has released Forge, a system that lets enterprises build frontier-level AI models from their own proprietary knowledge. It spans pretraining, post-training, and reinforcement learning; supports dense and MoE architectures; and accepts multimodal inputs.

    Why it matters: The source details the stages of training frontier models on enterprise data and names organizations already involved, helping readers assess the path and barriers to building models in-house.

3/12Thu
  1. Google Research62

    Google adds urban flash-flood forecasts to Flood Hub, with up to 24 hours' warning

    Google has announced that Flood Hub now includes urban flash-flood forecasts, using a new AI approach to predict urban flood risk up to 24 hours in advance.

    Why it matters: The source describes the modeling approach and evaluation results for urban flash-flood forecasting, helping readers assess the reach of AI flood warnings in the Global South.

  2. Google Research62

    Google launches Groundsource, using Gemini to turn news reports into disaster data

    Google has released Groundsource, a method for using Gemini to extract structured disaster data from global news. It has also opened the first urban flash-flood dataset, with 2.6 million records across more than 150 countries from 2000 to the present.

    Why it matters: Google turns global news into structured disaster data with Gemini and reports human-verified accuracy and coverage comparisons, helping readers assess whether the method can extend to other disasters.