Skip to content
K = 0.731

vLLM-Omni Adds Fish Audio Drama 3 Support With Voice Cloning and Streaming Audio

1 reports 1 reporting sources 2 days agoNew

Understand the event

AI overview

vLLM has added support for Fish Audio Drama 3 in vLLM-Omni, making voice cloning, speaker tags and expressive delivery available through the /v1/audio/speech endpoint with streaming 44.1 kHz audio. The model has 35B total parameters, with 3B active per token, and can now be served using the current upstream version. The merged optimization pull request reports 128 concurrent streams on a single H200 GPU, with a median time to first audio of 255 ms and throughput of 222.2 seconds of audio generated per second. Those results were averaged over five runs of 1,088 Seed-TTS-Eval English requests each, using pre-encoded voice references and running both stages on the same GPU.

Generated by AI from reports · Updated 2 days ago

Latest development10/15 16:39 (UTC+8)
Fish Audio Drama 3 is now supported in vLLM-OmnivLLM · X

Report timeline

Follow the reports to explore different sides of the event.

10/15
  1. vLLM · X
    Fish Audio Drama 3 is now supported in vLLM-Omni

    Fish Audio Drama 3 is now supported in vLLM-Omni, offering voice cloning, speaker tags, expressive delivery through /v1/audio/speech, and streaming 44.1 kHz audio. The merged optimization PR reports 128 concurrent streams on one H200, 255 ms median time to first audio, and 222.2 seconds of audio generated per second; both stages share the GPU, averaged over 5 runs of 1,088 Seed-TTS-Eval English requests per run with pre-encoded voice references. Try current upstream: vllm serve fishaudio/drama-3 --omni --port 8091 Recipe: https://github.com/vllm-project/vllm-omni/blob/main/recipes/fishaudio/Drama-3.md

Event heat trend

可比范围当前
3
Peak within comparable coverage
1010/15 17:00 (UTC+8)
近 24 小时变化
-49%

Trends compare the same continuously observed participants, which may cover fewer sources than current heat. Point or click to inspect hourly heat, or use left and right arrow keys.

Keep reading

Latest daily · Issue 24NVIDIA and AI4Bharat Introduce Nemotron-pretraining-Indic-v1 and an Open Data Generation Pipeline

Trending now

  1. 1Meta Releases Muse Spark Open With Mac and Cloud Support, Topping US Open-Weight Index
  2. 2Google Launches Gemini 4 Argon Globally, Expands Paid Access as Benchmark Results Vary
  3. 3OpenAI Updates GPT-6 Astra Pro in ChatGPT With Parallel Agents and Faster Responses
  4. 4Meta’s New Business Terms Raise Dispute Over Website Crawling and AI Training Rights