Skip to content

Data and training

The training side: building datasets, synthetic data, pre- and post-training methods, compute and training cost.

48 picksLast 30 days 19 itemsCollected 227 items

New

Picks archive · page 2

9/16Wed
  1. NVIDIA Blog62

    Jensen Huang at Dreamforce: Salesforce's first CRM reasoning model, Koa, is built on NVIDIA Nemotron 3 Super

    At Salesforce Dreamforce, NVIDIA founder and CEO Jensen Huang appeared alongside Marc Benioff as Salesforce released Koa, its first CRM reasoning model, built on NVIDIA Nemotron 3 Super.

    Why it matters: Huang discussed AI safety and shifts in the share of open models at Dreamforce, while the article explains how Salesforce's first reasoning model was trained and when it will be deployed.

  2. NVIDIA Blog62

    NVIDIA details DSX platform: MaxLPS delivers 24% more token throughput on the same power budget

    At the AI Infra Summit, NVIDIA presented its DSX platform. DSX MaxLPS was validated on Lambda's five-rack, 19-node HGX B200 cluster, where it increased token throughput by 24% under the same power budget—from about 4 million to 5 million tokens per second—and improved performance per watt by 23%.

    Why it matters: The article reports DSX MaxLPS measurements on a Lambda cluster, allowing readers to judge possible throughput gains under a fixed power budget.

  3. NVIDIA Blog72

    NVIDIA shares efficiency progress for Vera Rubin and DSX at AI Infra Summit

    At the AI Infra Summit, NVIDIA announced several advances in Vera Rubin and its DSX platform, shifting AI infrastructure measurement from peak performance to useful agentic tokens per megawatt.

    Why it matters: The article reports several measured token-output figures per megawatt for Vera Rubin and DSX, showing how efficiency metrics for AI factories are changing.

9/8Tue
  1. Google DeepMind71

    Google DeepMind's AlphaGenome Atlas covers predictions for 9 billion single-letter variants in the human genome

    Google DeepMind has released AlphaGenome Atlas, a platform containing predicted effects for 9 billion single-nucleotide variants in the human genome. At 1 PB, it is more than 30 times the size of the AlphaFold Database. From today, academic researchers can access it free through the web portal, AlphaGenome API, and a skill in Google Antigravity.

    Why it matters: The article gives the scale of predicted effects for 900 million single-nucleotide variants and free academic access points, helping readers assess the availability of genome-interpretation resources.

9/4Fri
  1. Google Research62

    Google, HHMI Janelia, and partners publish a complete male fruit-fly brain connectome

    In a paper published in Cell, Google, HHMI Janelia, Cambridge, and collaborators have published a connectome of the complete male fruit-fly brain and central nervous system. It contains more than 166,000 neurons and 125 million synaptic connections, making it the largest brain map to date by neuron count.

    Why it matters: Google, HHMI Janelia, and partners have released the largest brain map by neuron count, showing a concrete application of AI in connectomics.

9/3Thu
  1. Google DeepMind71

    Google DeepMind releases WeatherNext 3 global weather AI model

    Google DeepMind and Google Research have released WeatherNext 3, which they call the most advanced and accurate global weather model so far, based on independent real-time evaluations by Brightband.

    Why it matters: The article reports specific measures for resolution, update frequency, and precipitation accuracy, helping readers assess AI weather forecasting on real-time data.

8/28Fri
  1. Google Research62

    Google releases Planetary Prediction Engine to automate the full geospatial modeling workflow

    Google Research has introduced the experimental Planetary Prediction Engine (PPE) under Google Earth AI. From a natural-language query, it can autonomously discover geospatial data, engineer features, train and evaluate models, and produce a report—compressing weeks of manual data engineering into minutes.

    Why it matters: The article reports quantified improvements for PPE in public health, food security, and epidemic forecasting, giving a view of the practical limits of geospatial modeling automation.

8/25Tue
  1. Hugging Face Blog62

    IBM releases Granite 4.2 reasoning models in 3B, 8B, and 30B sizes

    IBM's Granite team has released Granite 4.2, its first family of dense decoder-only reasoning models, in 3B, 8B, and 30B sizes. They were post-trained from the Granite-4.1 base and are all licensed under Apache 2.0.

    Why it matters: The article discloses Granite 4.2's architecture, SFT data mix, and multi-stage RL curriculum in detail, offering a look at concrete post-training methods for reasoning models.

  2. Hugging Face Blog60

    Multiverse Computing proposes Quantization-Aware Healing: 4-bit compressed model beats its bfloat16 original on seven of nine benchmarks

    Multiverse Computing has published a paper proposing Quantization-Aware Healing (QAH). After compressing GPT-OSS 120B to 60B parameters and quantizing it to MXFP4, the method distills directly from the original model before compression rather than from a recovered bfloat16 checkpoint.

    Why it matters: The paper presents a repair recipe that distills from the original model after compression and quantization, with stability comparisons against QAT.

8/19Wed
  1. Hugging Face Blog62

    IBM research: how much memory does your agent actually need?

    The IBM research team has published follow-up work on ALTK-Evolve, evaluating eight models on 585 multi-step tasks in AppWorld. It finds that agent memory is not an on/off switch but a dosage that needs to be calibrated for each model.

    Why it matters: A comparison across eight models shows that the right amount of agent memory varies with model capability and offers two transferable ways to control costs: retrieval and prompt caching.

8/14Fri
  1. Hugging Face Blog62

    Hugging Face releases 2026 summer report on the open-model ecosystem

    Hugging Face has released a report on the open-model ecosystem from January through August 2026, drawing six findings from Hub data. Public model repositories grew from 2.43 million to 2.96 million and datasets from 711,000 to one million, but 85.6% of models have fewer than 200 lifetime downloads, while 1.5% of repositories account for 99.2% of downloads.

    Why it matters: Hugging Face analyzes its Hub data on the open-model ecosystem; findings on downloads versus likes and the scale of Qwen derivatives can inform model selection.

8/12Wed
  1. Google Research60

    Google Research proposes knowledge profiling: retrieval, not encoding, is the bottleneck for frontier LLM factuality

    Google Research has proposed a knowledge-profiling framework that distinguishes factual errors caused by encoding failures from those caused by retrieval failures, and released WikiProfile, a benchmark containing 2,150 Wikipedia facts.

    Why it matters: By separating encoding failures from retrieval failures, knowledge profiling offers a new way to diagnose the sources of factual errors in frontier models.

8/6Thu
  1. Google DeepMind76

    Google DeepMind open-sources WeatherNext cyclone forecasting model

    Google DeepMind has released WeatherNext, an AI model that achieves state-of-the-art forecasts of cyclone tracks, intensity, and wind-field structure, providing about one additional day of lead time on average—roughly a decade of progress in meteorology.

    Why it matters: The source reports measured gains of about one additional day of warning for cyclone tracks and intensity and opens the model weights and code.

7/31Fri
  1. Google Research62

    Google Research proposes Science One Framework for verifiable autonomous research with Chain-of-Evidence

    Google Research has proposed Chain-of-Evidence (CoE), a framework for verifiability implemented in the autonomous-research prototype Science One Framework and the automated auditing tool CoE Audit.

    Why it matters: The article reports a verifiability framework and audit metrics, helping readers compare autonomous research systems on citation and code consistency.

  2. Microsoft Research71

    Microsoft Research releases Echoverse, an evolving training environment for computer-use agents

    Microsoft Research has introduced Echoverse, a set of 12 training worlds for computer-use agents: 10 full-domain environments and two capability environments. Each consists of an application, tasks, and a database-based verifier.

    Why it matters: Microsoft Research has released 12 computer-use-agent training environments with verifiers and reports comparisons of transfer performance between deep and shallow environments.

7/21Tue
  1. Hugging Face Blog62

    Hugging Face releases Grabette, an open system for recording robot manipulation data

    Hugging Face has released Grabette, a low-cost, open-source handheld gripper system for recording robot-manipulation demonstrations without a robot or teleoperation rig. It has a wide-angle fisheye camera and an RGB-D camera for policy-view recording and 6-DoF trajectory tracking, respectively. The hardware bill of materials is about €490; the companion robot-side gripper, Gripette, costs about €120.

    Why it matters: The source describes the full open pipeline from handheld-gripper recording to LeRobot datasets, helping readers assess how the barrier to collecting manipulation data is changing.

7/9Thu
  1. Google Research62

    Google releases SensorFM, a large sensor foundation model for wearable-health data

    Google Research and Google DeepMind have introduced SensorFM, a large sensor foundation model that learns directly from unlabeled wearable data. Its pretraining corpus contains more than one trillion minutes of multimodal sensor signals from five million consenting participants across more than 100 countries, all 50 U.S. states, and over 20 Fitbit and Pixel Watch devices.

    Why it matters: The article reports pretraining-data scale, scaling experiments, and downstream-task comparisons, helping readers assess how generalizable wearable foundation models are.

7/7Tue
  1. Hugging Face Blog74

    LeRobot v0.6.0 released: imagine, evaluate, improve

    Hugging Face has released LeRobot v0.6.0, adding world-model policies (VLA-JEPA, FastWAM, LingBot-VA), a new set of VLA models (GR00T N1.7, MolmoAct2, EO-1, EVO1, Multitask DiT), and a unified reward-model API (Robometer, TOPReward) to the robotics-learning loop.

    Why it matters: The release brings world-model policies, a reward-model API, and six simulation benchmarks into one CLI, giving readers a view of how production-ready the robotics-learning loop is becoming.

6/30Tue
  1. Google Research76

    Google releases TabFM, a zero-shot foundation model for tabular data

    Google has released TabFM, a zero-shot foundation model for classification and regression on tabular data. It recasts table prediction as an in-context-learning problem, producing predictions in a single forward pass without manual training, tuning, or feature engineering.

    Why it matters: The source details TabFM's architecture and TabArena results, helping readers assess whether zero-shot table prediction can replace traditional tree-model workflows.

5/27Wed
  1. Mistral AI62

    Mistral introduces physical AI, integrating Emmi AI into its enterprise platform

    Mistral says it is bringing Emmi AI into the company and launching physical-AI capabilities for industrial engineering as a new foundational feature of its enterprise solutions. The models predict physical fields directly from geometry and boundary conditions in a single forward pass taking seconds on one GPU, enabling design iteration. Traditional solvers remain available for verification and edge cases.

    Why it matters: Mistral is integrating physics-simulation models into its enterprise platform, offering a view of potential changes to compute requirements and iteration speed in industrial design.