Skip to content
K = 0.731
2026.10.17 · Sat

#语音

#语音

First-party

Direct announcements from model vendors, companies and research institutions on their official sites, blogs and accounts.

10/16Fri
  1. Hugging Face Blog74

    Granite Switch 4.1 Combines Chat, Decisions, and Speech in One Endpoint

    IBM released Granite-Switch-4.1-8B and -30B, combining chat, a general-purpose Decision aLoRA, a specialized Guardian aLoRA, and Granite-Speech-5.0-Turbo-CTC transcription through one hosted endpoint. IBM says the combined model uses approximately the same GPU VRAM as its base model, with adapters reusing the base model’s KV cache. Users can also compose custom Switch models from Granite Libraries adapters; an Adapter SDK for training adapters in Mellea is planned.

    Why it matters: Shared KV caches and modular adapters offer a concrete approach to combining general and specialized decisions with transcription while keeping GPU memory use close to the base model.

9/30Wed
  1. Hugging Face Blog60

    Hugging Face releases Open TTS Leaderboard for objective evaluation of multilingual TTS and voice cloning

    Hugging Face released Open TTS Leaderboard, which uses objective metrics including WER/CER, RTFx, TTFA, and speaker similarity to evaluate open-source TTS models, reducing evaluation cycles from weeks of voting to hours.

    Why it matters: Hugging Face replaces vote-based evaluation with objective metrics, showing how to compare open-source TTS models across languages and voice cloning.

9/25Fri
  1. Google DeepMind71

    Google DeepMind releases Gemini 3.8 Live with Live Avatar

    Google DeepMind has released Gemini 3.8 Live with Live Avatar, combining real-time video generation and voice to give Gemini's conversational model a near-real-time visual avatar, with accurate lip-sync, natural expressions, and smooth turn-taking.

    Why it matters: Gemini 3.8 Live adds real-time video avatars, giving readers a view of how multimodal conversation is being applied in enterprise settings and where the feature is available.

9/23Wed
  1. Google DeepMind71

    Google DeepMind releases Gemini 3.8 Flash TTS and Flash-Lite TTS

    Google DeepMind has released two speech-generation models: Gemini 3.8 Flash TTS for character design and fine-grained creative control, and Gemini 3.8 Flash-Lite TTS for high-volume voiceovers and voice agents.

    Why it matters: The article outlines the models' voice cloning, line-by-line direction, and benchmark results, helping readers assess their suitability for dubbing and podcast production.

9/16Wed
  1. Google DeepMind82

    Google DeepMind releases Gemini 3.8 Live and 3.8 Live Extended Thinking

    Google DeepMind has released two real-time voice-conversation models: Gemini 3.8 Live for scale and cost efficiency, and Gemini 3.8 Live Extended Thinking for complex tasks and multi-step reasoning.

    Why it matters: The two live voice models support parallel reasoning and tool calls and report results on several speech benchmarks, offering a way to assess the limits of voice agents.

9/10Thu
  1. OpenAI News65

    OpenAI introduces GPT-Live-1 voice model in its API

    OpenAI has introduced GPT-Live-1 in its API, giving developers natural full-duplex voice conversations. The model follows instructions more reliably and supports custom voices and telephony integration.

    Why it matters: GPT-Live-1 brings full-duplex voice conversation to the API, helping readers assess how to integrate voice apps and the model's capabilities.

8/28Fri
  1. Hugging Face Blog60

    Open ASR Leaderboard adds Monsoon, its first benchmark set for Global South languages

    Voice Arena and Hugging Face have added Monsoon en-IN and Monsoon hi-IN to the Open ASR Leaderboard, making Hindi the first Indian language represented on the multilingual leaderboard.

    Why it matters: The Open ASR Leaderboard has added its first Hindi and Indian English benchmarks, showing how speaker attributes are being incorporated into public evaluations.

8/27Thu
  1. Google DeepMind71

    Google DeepMind releases Gemini 3.5 Transcribe speech-to-text model

    Google DeepMind has released Gemini 3.5 Transcribe, which it calls its most accurate speech-to-text model yet. It converts raw audio directly into accurate, formatted text.

    Why it matters: The official post reports WER for streaming and non-streaming APIs and compares the model with the previous-generation Chirp 3, helping readers assess speech transcription in practical workflows.

8/21Fri
  1. Hugging Face Blog60

    Hugging Face research measures benchmark optimization in speech recognition

    Hugging Face has published research measuring benchmark optimization in speech recognition through three tests: consensus disagreement, masked-entity retrieval, and spelling switches. The study evaluates 11 open-source ASR models.

    Why it matters: The study presents three reproducible probes and quantifies how often ASR models reproduce incorrect benchmark transcripts, with direct implications for evaluation design.

8/12Wed
  1. Google Research72

    Google researchers advance AMIE to expert-level clinical interviews with audio and video

    Google Research has released AMIE (Video), which uses Gemini and Project Astra for real-time video clinical interviews. It can perceive nonverbal cues, guide virtual physical examinations, and reason about diagnoses in real time.

    Why it matters: AMIE extends from text to live video consultations, showing how an asynchronous multi-agent architecture can balance conversational latency with clinical reasoning.

8/11Tue
  1. Hugging Face Blog62

    NVIDIA releases open-weights Magpie TTS multilingual model, adding Arabic, Korean, and Brazilian Portuguese

    NVIDIA has released Magpie TTS Multilingual, a 364M-parameter open-weights speech-synthesis model supporting 12 languages. The latest release adds Modern Standard Arabic, Korean, and Brazilian Portuguese, and improves quality in several existing languages through updated training data.

    Why it matters: The article reports the 364M open TTS model's language expansion and measured TTFA on different GPUs, helping readers estimate latency budgets for self-hosted voice pipelines.

7/15Wed
  1. Hugging Face Blog62

    Hume releases Real World VoiceEQ to measure human quality in voice AI

    Hume has released Real World VoiceEQ, a benchmark for human quality in voice interaction. It covers more than 40 proprietary and open-source voice models, over 15 evaluation dimensions, and more than 60 metrics across ASR, TTS, speech-to-speech, and voice understanding.

    Why it matters: Hume built a voice-AI benchmark from more than a million human ratings, showing why current metrics can overestimate real conversational performance.

7/1Wed
  1. Hugging Face Blog62

    Hugging Face and Cerebras bring Gemma 4 to real-time voice AI

    Hugging Face and Cerebras demonstrated a real-time speech-to-speech pipeline using Cerebras to accelerate Gemma 4 31B inference, bringing voice-interaction latency closer to natural conversation.

    Why it matters: The source presents a replaceable open-source speech-to-speech pipeline, helping readers assess engineering combinations for low-latency voice interaction.

6/9Tue
  1. Google DeepMind78

    Google DeepMind releases Gemini 3.5 Live Translate real-time speech translation model

    Google DeepMind has released Gemini 3.5 Live Translate, a near-real-time speech-to-speech translation audio model supporting more than 70 languages. It detects languages automatically and preserves the speaker's intonation, rhythm, and pitch.

    Why it matters: Gemini 3.5 Live Translate replaces sentence-by-sentence waiting with continuous generation and offers developer, enterprise, and consumer deployment paths.

4/30Thu
  1. Google DeepMind62

    Google DeepMind launches AI co-clinician research program

    Google DeepMind has announced an AI co-clinician research program exploring a “triple-care” model in which AI agents assist with patient care under clinical supervision. In blind evaluation of 98 real primary-care queries, the system had no critical errors in 97 cases, and doctors preferred its responses to those from existing evidence-synthesis tools. It also outperformed other frontier models on open-ended medication questions in OpenFDA's RxQA.

    Why it matters: Google DeepMind reports results from physician blind reviews, RxQA, and simulated remote consultations, offering a view of current medical-AI capabilities.

4/16Thu
  1. Google DeepMind71

    Google DeepMind releases Gemini 3.1 Flash TTS voice model

    Google DeepMind has released Gemini 3.1 Flash TTS, a text-to-speech model focused on control, expressiveness, and audio quality. It is available in developer preview through the Gemini API and Google AI Studio, in enterprise preview on Vertex AI, and to Workspace users through Google Vids.

    Why it matters: The official release explains how to use audio tags and lists language coverage, helping readers assess how controllable speech generation is.

3/24Tue
  1. Mistral AI62

    Mistral AI releases Voxtral TTS speech-synthesis model

    Mistral AI has released Voxtral TTS, its first text-to-speech model. The 4B model supports nine languages—English, French, German, Spanish, Dutch, Portuguese, Italian, Hindi, and Arabic—and offers expressive emotion and low latency.

    Why it matters: The source reports the 4B model's language coverage and 70 ms latency, and compares it with ElevenLabs, helping readers assess cost and usability for voice agents.

2/5Thu
  1. Mistral AI72

    Mistral releases Voxtral Transcribe 2 speech-to-text model family

    Mistral has released Voxtral Transcribe 2, with two speech-to-text models: Voxtral Mini Transcribe V2 for batch transcription and Voxtral Realtime for live use.

    Why it matters: The source reports latency, pricing, and open-source licensing for both transcription models, helping readers assess options for real-time speech workloads.

7/17Thu
  1. Mistral AI62

    Mistral adds Deep Research, voice mode, and more to Le Chat

    Mistral has introduced several new features in Le Chat, including a preview of Deep Research mode, voice mode powered by the new Voxtral model, multilingual reasoning supported by the Magistral reasoning model, Projects for organizing conversations, and image editing in partnership with Black Forest Labs.

    Why it matters: Mistral has brought deep research, voice, reasoning, and image editing into Le Chat at once, giving readers a view of the assistant's expanding capabilities.

7/15Tue
  1. Mistral AI78

    Mistral releases Voxtral speech-understanding models in open 24B and 3B sizes

    Mistral has released Voxtral speech-understanding models in 24B and 3B sizes, both open-source under Apache 2.0 and available through an API. They support a 32K-token context, can transcribe up to 30 minutes of audio or understand up to 40 minutes, and provide built-in question answering and summarization, automatic multilingual detection, and speech-triggered function calls. Their text capabilities are inherited from Mistral Small 3.1.

    Why it matters: Mistral's open speech-understanding models come in two sizes, under Apache 2.0, with API pricing disclosed, helping readers assess transcription and audio-understanding costs.

You've reached the end