Skip to content
K = 0.731
All news · Today2 items

#Voice

All collected and published items, ordered by time. Picks are a selected subset.
9/24Thu
  1. Greg Brockman · X82

    ChatGPT Voice upgrade adds app integrations and ChatGPT Work

    ChatGPT Voice has been upgraded to work with integrations such as email, calendars, and Slack, and to connect to ChatGPT Work. On web and mobile, users can create documents, presentations, websites, and spreadsheets by voice, or handle complex tasks in the browser. Powered by GPT-6 Astra, Sol, and Luna, the feature begins rolling out globally today with the latest app release.

    Why it matters: With email, calendar, and Slack integrations and access to Work, ChatGPT Voice gives readers a way to assess which workflows can be handled through voice.

9/23Wed
  1. Logan Kilpatrick · X71

    Google releases Gemini 3.8 Flash and Flash-Lite TTS voice models

    Google has released the Gemini 3.8 Flash and Flash-Lite text-to-speech models, describing them as new state-of-the-art voice models. They offer a new voice-design experience, more than 2,000 production-ready voices, voice cloning, and support for 100 languages; voice mixing is coming soon. Google says they rank first on Hume AI's voice benchmark.

    Why it matters: Google's Gemini 3.8 Flash and Flash-Lite TTS release lists more than 2,000 voices, support for 100 languages, voice cloning, and other capabilities.

  2. Google DeepMind · X62

    Google DeepMind releases Gemini 3.8 Flash TTS and Flash-Lite TTS

    Google DeepMind has released two text-to-speech models. Gemini 3.8 Flash TTS can design custom voices with different accents and characteristics; Gemini 3.8 Flash-Lite TTS is aimed at efficiency and scale, with a choice of custom styles or an official library of production-ready voices. The company says they can be used to create and deploy custom audio.

  3. Google DeepMind71

    Google DeepMind releases Gemini 3.8 Flash TTS and Flash-Lite TTS

    Google DeepMind has released two speech-generation models: Gemini 3.8 Flash TTS for character design and fine-grained creative control, and Gemini 3.8 Flash-Lite TTS for high-volume voiceovers and voice agents.

    Why it matters: The article outlines the models' voice cloning, line-by-line direction, and benchmark results, helping readers assess their suitability for dubbing and podcast production.

  5. Qwen · X71

    Alibaba releases Qwen-Audio-3.1 family, including TTS-Next and ASR-Next

    Alibaba has released Qwen-Audio-3.1 with upgrades to ASR, TTS, and Realtime, plus two new models, TTS-Next and ASR-Next. Five models now cover audio understanding, generation, interaction, and creation.

    Why it matters: The article lists the capabilities of all five audio models and their price reductions, helping readers assess voice-stack choices and cost changes.

9/16Wed
  1. Logan Kilpatrick · X72

    Google releases Gemini 3.8 Live and 3.8 Live Extended Thinking real-time audio models

    Google has released Gemini 3.8 Live and Gemini 3.8 Live Extended Thinking, new state-of-the-art real-time audio models positioned for leading price and performance. Gemini 3.8 Live supports 97 languages with seamless switching, as well as asynchronous tool calls and other features.

    Why it matters: Google's new real-time audio models offer language coverage and asynchronous tool calls, helping readers assess the practical limits of live voice interaction.

  2. Google DeepMind82

    Google DeepMind releases Gemini 3.8 Live and 3.8 Live Extended Thinking

    Google DeepMind has released two real-time voice-conversation models: Gemini 3.8 Live for scale and cost efficiency, and Gemini 3.8 Live Extended Thinking for complex tasks and multi-step reasoning.

    Why it matters: The two live voice models support parallel reasoning and tool calls and report results on several speech benchmarks, offering a way to assess the limits of voice agents.

  3. Google DeepMind · X77

    Google DeepMind releases Gemini 3.8 Live and 3.8 Live Extended Thinking

    Google DeepMind has released Gemini 3.8 Live and Gemini 3.8 Live Extended Thinking, calling them its best conversational AI yet. The company says the models can converse and think while handling tasks in the background without interrupting the user's workflow.

    Why it matters: The new conversational models give readers an update on Google DeepMind's positioning for real-time dialogue and background task handling.

9/10Thu
  1. OpenAI News65

    OpenAI introduces GPT-Live-1 voice model in its API

    OpenAI has introduced GPT-Live-1 in its API, giving developers natural full-duplex voice conversations. The model follows instructions more reliably and supports custom voices and telephony integration.

    Why it matters: GPT-Live-1 brings full-duplex voice conversation to the API, helping readers assess how to integrate voice apps and the model's capabilities.

8/28Fri
  1. Hugging Face Blog60

    Open ASR Leaderboard adds Monsoon, its first benchmark set for Global South languages

    Voice Arena and Hugging Face have added Monsoon en-IN and Monsoon hi-IN to the Open ASR Leaderboard, making Hindi the first Indian language represented on the multilingual leaderboard.

    Why it matters: The Open ASR Leaderboard has added its first Hindi and Indian English benchmarks, showing how speaker attributes are being incorporated into public evaluations.

8/27Thu
  1. Google DeepMind71

    Google DeepMind releases Gemini 3.5 Transcribe speech-to-text model

    Google DeepMind has released Gemini 3.5 Transcribe, which it calls its most accurate speech-to-text model yet. It converts raw audio directly into accurate, formatted text.

    Why it matters: The official post reports WER for streaming and non-streaming APIs and compares the model with the previous-generation Chirp 3, helping readers assess speech transcription in practical workflows.

8/25Tue
  1. Mistral AI · X38

    Mistral and HUMAIN announce strategic partnership

    Today we announced a strategic partnership with @HUMAIN spanning AI infrastructure, advanced model development, and deployment of AI solutions in Saudi Arabia and the broader region. We will jointly develop localized frontier AI models, initially focused on cybersecurity, voice, and strong performance in Arabic-language markets. https://mistral.ai/news/mistral-x-humain/

8/21Fri
  1. Hugging Face Blog60

    Hugging Face research measures benchmark optimization in speech recognition

    Hugging Face has published research measuring benchmark optimization in speech recognition through three tests: consensus disagreement, masked-entity retrieval, and spelling switches. The study evaluates 11 open-source ASR models.

    Why it matters: The study presents three reproducible probes and quantifies how often ASR models reproduce incorrect benchmark transcripts, with direct implications for evaluation design.

8/12Wed
  1. Google Research72

    Google researchers advance AMIE to expert-level clinical interviews with audio and video

    Google Research has released AMIE (Video), which uses Gemini and Project Astra for real-time video clinical interviews. It can perceive nonverbal cues, guide virtual physical examinations, and reason about diagnoses in real time.

    Why it matters: AMIE extends from text to live video consultations, showing how an asynchronous multi-agent architecture can balance conversational latency with clinical reasoning.

8/11Tue
  1. Hugging Face Blog62

    NVIDIA releases open-weights Magpie TTS multilingual model, adding Arabic, Korean, and Brazilian Portuguese

    NVIDIA has released Magpie TTS Multilingual, a 364M-parameter open-weights speech-synthesis model supporting 12 languages. The latest release adds Modern Standard Arabic, Korean, and Brazilian Portuguese, and improves quality in several existing languages through updated training data.

    Why it matters: The article reports the 364M open TTS model's language expansion and measured TTFA on different GPUs, helping readers estimate latency budgets for self-hosted voice pipelines.

7/30Thu
  1. Google DeepMind58

    Google DeepMind releases Lyria 3.5 music-generation model in Flow Music

    Google DeepMind has released Lyria 3.5, its next-generation music-generation model, in Google Flow Music. The release improves musicianship, lyrics, vocals, and creative control: it produces richer, more natural melodic structures; improves lyric quality, prompt adherence, and structure awareness; offers more expressive vocals with finer emotional detail and better pronunciation; and makes tempo and duration easier to control.

7/22Wed
  1. Andrej Karpathy · X28

    Karpathy shares a 'long voice ramble' technique for working with LLMs

    Andrej Karpathy shares a practical way to work with LLMs: switch to `/voice` and spend about ten minutes stream-of-consciousness talking through ideas, even if they are messy. He says LLMs are good at restructuring long, incoherent rambles; the resulting reflection often makes the thinking clearer than the original input, deepening the “mind meld” and reducing later corrections.

7/15Wed
  1. Hugging Face Blog62

    Hume releases Real World VoiceEQ to measure human quality in voice AI

    Hume has released Real World VoiceEQ, a benchmark for human quality in voice interaction. It covers more than 40 proprietary and open-source voice models, over 15 evaluation dimensions, and more than 60 metrics across ASR, TTS, speech-to-speech, and voice understanding.

    Why it matters: Hume built a voice-AI benchmark from more than a million human ratings, showing why current metrics can overestimate real conversational performance.

7/1Wed
  1. Hugging Face Blog62

    Hugging Face and Cerebras bring Gemma 4 to real-time voice AI

    Hugging Face and Cerebras demonstrated a real-time speech-to-speech pipeline using Cerebras to accelerate Gemma 4 31B inference, bringing voice-interaction latency closer to natural conversation.

    Why it matters: The source presents a replaceable open-source speech-to-speech pipeline, helping readers assess engineering combinations for low-latency voice interaction.

6/9Tue
  1. Google DeepMind78

    Google DeepMind releases Gemini 3.5 Live Translate real-time speech translation model

    Google DeepMind has released Gemini 3.5 Live Translate, a near-real-time speech-to-speech translation audio model supporting more than 70 languages. It detects languages automatically and preserves the speaker's intonation, rhythm, and pitch.

    Why it matters: Gemini 3.5 Live Translate replaces sentence-by-sentence waiting with continuous generation and offers developer, enterprise, and consumer deployment paths.

5/2Sat
4/30Thu
  1. Google DeepMind62

    Google DeepMind launches AI co-clinician research program

    Google DeepMind has announced an AI co-clinician research program exploring a “triple-care” model in which AI agents assist with patient care under clinical supervision. In blind evaluation of 98 real primary-care queries, the system had no critical errors in 97 cases, and doctors preferred its responses to those from existing evidence-synthesis tools. It also outperformed other frontier models on open-ended medication questions in OpenFDA's RxQA.

    Why it matters: Google DeepMind reports results from physician blind reviews, RxQA, and simulated remote consultations, offering a view of current medical-AI capabilities.

4/16Thu
  1. Google DeepMind71

    Google DeepMind releases Gemini 3.1 Flash TTS voice model

    Google DeepMind has released Gemini 3.1 Flash TTS, a text-to-speech model focused on control, expressiveness, and audio quality. It is available in developer preview through the Gemini API and Google AI Studio, in enterprise preview on Vertex AI, and to Workspace users through Google Vids.

    Why it matters: The official release explains how to use audio tags and lists language coverage, helping readers assess how controllable speech generation is.

3/24Tue
  1. Mistral AI62

    Mistral AI releases Voxtral TTS speech-synthesis model

    Mistral AI has released Voxtral TTS, its first text-to-speech model. The 4B model supports nine languages—English, French, German, Spanish, Dutch, Portuguese, Italian, Hindi, and Arabic—and offers expressive emotion and low latency.

    Why it matters: The source reports the 4B model's language coverage and 70 ms latency, and compares it with ElevenLabs, helping readers assess cost and usability for voice agents.

2/5Thu
7/17Thu
  1. Mistral AI62

    Mistral adds Deep Research, voice mode, and more to Le Chat

    Mistral has introduced several new features in Le Chat, including a preview of Deep Research mode, voice mode powered by the new Voxtral model, multilingual reasoning supported by the Magistral reasoning model, Projects for organizing conversations, and image editing in partnership with Black Forest Labs.

    Why it matters: Mistral has brought deep research, voice, reasoning, and image editing into Le Chat at once, giving readers a view of the assistant's expanding capabilities.

7/15Tue
  1. Mistral AI78

    Mistral releases Voxtral speech-understanding models in open 24B and 3B sizes

    Mistral has released Voxtral speech-understanding models in 24B and 3B sizes, both open-source under Apache 2.0 and available through an API. They support a 32K-token context, can transcribe up to 30 minutes of audio or understand up to 40 minutes, and provide built-in question answering and summarization, automatic multilingual detection, and speech-triggered function calls. Their text capabilities are inherited from Mistral Small 3.1.

    Why it matters: Mistral's open speech-understanding models come in two sizes, under Apache 2.0, with API pricing disclosed, helping readers assess transcription and audio-understanding costs.