Skip to content
2026.10.17 · Sat

#评测/基准

#评测/基准

First-party

Direct announcements from model vendors, companies and research institutions on their official sites, blogs and accounts.

9/30Wed
  1. Hugging Face Blog60

    Hugging Face releases Open TTS Leaderboard for objective evaluation of multilingual TTS and voice cloning

    Hugging Face released Open TTS Leaderboard, which uses objective metrics including WER/CER, RTFx, TTFA, and speaker similarity to evaluate open-source TTS models, reducing evaluation cycles from weeks of voting to hours.

    Why it matters: Hugging Face replaces vote-based evaluation with objective metrics, showing how to compare open-source TTS models across languages and voice cloning.

8/21Fri
  1. Hugging Face Blog60

    Hugging Face research measures benchmark optimization in speech recognition

    Hugging Face has published research measuring benchmark optimization in speech recognition through three tests: consensus disagreement, masked-entity retrieval, and spelling switches. The study evaluates 11 open-source ASR models.

    Why it matters: The study presents three reproducible probes and quantifies how often ASR models reproduce incorrect benchmark transcripts, with direct implications for evaluation design.

7/15Wed
  1. Hugging Face Blog62

    Hume releases Real World VoiceEQ to measure human quality in voice AI

    Hume has released Real World VoiceEQ, a benchmark for human quality in voice interaction. It covers more than 40 proprietary and open-source voice models, over 15 evaluation dimensions, and more than 60 metrics across ASR, TTS, speech-to-speech, and voice understanding.

    Why it matters: Hume built a voice-AI benchmark from more than a million human ratings, showing why current metrics can overestimate real conversational performance.

7/7Tue
  1. Hugging Face Blog74

    LeRobot v0.6.0 released: imagine, evaluate, improve

    Hugging Face has released LeRobot v0.6.0, adding world-model policies (VLA-JEPA, FastWAM, LingBot-VA), a new set of VLA models (GR00T N1.7, MolmoAct2, EO-1, EVO1, Multitask DiT), and a unified reward-model API (Robometer, TOPReward) to the robotics-learning loop.

    Why it matters: The release brings world-model policies, a reward-model API, and six simulation benchmarks into one CLI, giving readers a view of how production-ready the robotics-learning loop is becoming.

You've reached the end