Skip to content
K = 0.731
2026.10.17 · Sat

#Hugging Face

#Hugging Face

Research

Research papers, technical reports, benchmarks and datasets.

10/15Thu
  1. Hugging Face Blog73

    HiRO-ACEv2 simulates extreme weather at 3 km resolution for a fraction of the cost

    Ai2 introduced HiRO-ACEv2, an updated climate emulator that generates global 3 km rain, wind, and pressure data at about 1/300th the cost of X-SHiELD. Given coarsened X-SHiELD data, its HiROv2 downscaling model matches high-resolution statistics to within 3%, even for events occurring once in a million data points. The system currently works only with ACE tuned to match X-SHiELD and cannot yet generate high-resolution data for other climates; downloadable models, tutorial notebooks, and a web demo are available.

    Why it matters: The comparison with X-SHiELD gives researchers a concrete cost and accuracy reference for extreme weather simulations, with applicability currently limited to the climate represented in training.

10/7Wed
  1. Hugging Face Blog62

    Nemotron fine-tuning reaches gold-medal level at both IOI 2026 and IMO 2026

    The NVIDIA team started with Nemotron 3 and used supervised fine-tuning, reinforcement learning, and a generate-verify-improve reasoning process to build specialized models that reached gold-medal thresholds at both IOI 2026 and IMO 2026.

    Why it matters: The source gives a complete recipe for fine-tuning Nemotron 3 to gold-medal-level results at IOI and IMO, which readers can use to reproduce its data and reasoning workflow.

10/4Sun
  1. Hugging Face Blog71

    Microsoft's ThinkingBox agent benchmark checks final database state, not tool calls

    The Microsoft Copilot Studio team and Hugging Face jointly released ThinkingBox. It runs agents in isolated MCP tool sessions and then performs executable checks on final backend state and side effects, rather than judging only the final reply or whether tool calls were allowed.

    Why it matters: The agent benchmark from Microsoft and Hugging Face uses 507 stateful workflows and 20 repeated runs, shifting the focus from tool calls to the final database state.

10/2Fri
  1. Hugging Face · X74

    Hugging Face publishes multi-harness RL guide: the same model scores 62% versus 33% with different harnesses

    The Hugging Face team published a multi-harness RL guide, showing that the same model with identical weights can score 62% with one agent harness and 33% with another.

    Why it matters: Scores for the same model differ by nearly half across agent harnesses. This open guide gives a multi-harness RL training path without changing the harness, along with measured comparisons.

8/28Fri
  1. Hugging Face Blog60

    Open ASR Leaderboard adds Monsoon, its first benchmark set for Global South languages

    Voice Arena and Hugging Face have added Monsoon en-IN and Monsoon hi-IN to the Open ASR Leaderboard, making Hindi the first Indian language represented on the multilingual leaderboard.

    Why it matters: The Open ASR Leaderboard has added its first Hindi and Indian English benchmarks, showing how speaker attributes are being incorporated into public evaluations.

8/25Tue
  1. Hugging Face Blog60

    Multiverse Computing proposes Quantization-Aware Healing: 4-bit compressed model beats its bfloat16 original on seven of nine benchmarks

    Multiverse Computing has published a paper proposing Quantization-Aware Healing (QAH). After compressing GPT-OSS 120B to 60B parameters and quantizing it to MXFP4, the method distills directly from the original model before compression rather than from a recovered bfloat16 checkpoint.

    Why it matters: The paper presents a repair recipe that distills from the original model after compression and quantization, with stability comparisons against QAT.

8/22Sat
  1. Jim Fan · X69

    NVIDIA and Berkeley open-source T-Rex methodology for tactile robot learning

    Jim Fan announces T-Rex, an open-source tactile robot learning methodology developed through a collaboration between NVIDIA and Berkeley. Its mixture-of-transformer architecture pairs a slow visuomotor expert with a fast tactile expert running at 4 touch ticks per vision tick; a 50-hour (~5,500 episodes) synchronized robot play dataset collected on tactile hand hardware with 22 degrees of freedom is available today on HuggingFace. Extending EgoScale, its training recipe combines human egocentric video pretraining with tactile robot play mid-training, which Fan says helps bridge contact-free pretraining and contact-rich manipulation.

    Why it matters: T-Rex offers a transferable approach to contact-rich robot learning by combining human video pretraining, synchronized tactile robot data, and separate visual and tactile processing rates.

8/21Fri
  1. Hugging Face Blog60

    Hugging Face research measures benchmark optimization in speech recognition

    Hugging Face has published research measuring benchmark optimization in speech recognition through three tests: consensus disagreement, masked-entity retrieval, and spelling switches. The study evaluates 11 open-source ASR models.

    Why it matters: The study presents three reproducible probes and quantifies how often ASR models reproduce incorrect benchmark transcripts, with direct implications for evaluation design.

8/19Wed
  1. Hugging Face Blog62

    IBM research: how much memory does your agent actually need?

    The IBM research team has published follow-up work on ALTK-Evolve, evaluating eight models on 585 multi-step tasks in AppWorld. It finds that agent memory is not an on/off switch but a dosage that needs to be calibrated for each model.

    Why it matters: A comparison across eight models shows that the right amount of agent memory varies with model capability and offers two transferable ways to control costs: retrieval and prompt caching.

8/13Thu
  1. Hugging Face Blog78

    Hugging Face uses agents to reproduce more than 2,200 ICML papers

    Hugging Face ran the ICML 2026 Open Reproduction Challenge from July 15 to August 2. A community of 1,221 used coding agents such as Claude Code, Codex, and Cursor to reproduce papers, publishing 6,816 Trackio logbooks covering 2,226 papers—about 34% of all papers at the conference.

    Why it matters: Hugging Face has published reproduction results and adjudication data for more than 2,200 ICML papers, offering a view of the limits of agents in scientific reproduction.

7/15Wed
  1. Hugging Face Blog62

    Hume releases Real World VoiceEQ to measure human quality in voice AI

    Hume has released Real World VoiceEQ, a benchmark for human quality in voice interaction. It covers more than 40 proprietary and open-source voice models, over 15 evaluation dimensions, and more than 60 metrics across ASR, TTS, speech-to-speech, and voice understanding.

    Why it matters: Hume built a voice-AI benchmark from more than a million human ratings, showing why current metrics can overestimate real conversational performance.

You've reached the end