Research papers, technical reports, benchmarks and datasets.
Voice Arena and Hugging Face have added Monsoon en-IN and Monsoon hi-IN to the Open ASR Leaderboard, making Hindi the first Indian language represented on the multilingual leaderboard.
Why it matters: The Open ASR Leaderboard has added its first Hindi and Indian English benchmarks, showing how speaker attributes are being incorporated into public evaluations.
Hugging Face has published research measuring benchmark optimization in speech recognition through three tests: consensus disagreement, masked-entity retrieval, and spelling switches. The study evaluates 11 open-source ASR models.
Why it matters: The study presents three reproducible probes and quantifies how often ASR models reproduce incorrect benchmark transcripts, with direct implications for evaluation design.
Google Research has released AMIE (Video), which uses Gemini and Project Astra for real-time video clinical interviews. It can perceive nonverbal cues, guide virtual physical examinations, and reason about diagnoses in real time.
Why it matters: AMIE extends from text to live video consultations, showing how an asynchronous multi-agent architecture can balance conversational latency with clinical reasoning.
Hume has released Real World VoiceEQ, a benchmark for human quality in voice interaction. It covers more than 40 proprietary and open-source voice models, over 15 evaluation dimensions, and more than 60 metrics across ASR, TTS, speech-to-speech, and voice understanding.
Why it matters: Hume built a voice-AI benchmark from more than a million human ratings, showing why current metrics can overestimate real conversational performance.
Google DeepMind has announced an AI co-clinician research program exploring a “triple-care” model in which AI agents assist with patient care under clinical supervision. In blind evaluation of 98 real primary-care queries, the system had no critical errors in 97 cases, and doctors preferred its responses to those from existing evidence-synthesis tools. It also outperformed other frontier models on open-ended medication questions in OpenFDA's RxQA.
Why it matters: Google DeepMind reports results from physician blind reviews, RxQA, and simulated remote consultations, offering a view of current medical-AI capabilities.
