Fish Audio Drama 3 is now supported in vLLM-Omni
Fish Audio Drama 3 is now supported in vLLM-Omni, offering voice cloning, speaker tags, expressive delivery through /v1/audio/speech, and streaming 44.1 kHz audio. The merged optimization PR reports 128 concurrent streams on one H200, 255 ms median time to first audio, and 222.2 seconds of audio generated per second; both stages share the GPU, averaged over 5 runs of 1,088 Seed-TTS-Eval English requests per run with pre-encoded voice references. Try current upstream: vllm serve fishaudio/drama-3 --omni --port 8091 Recipe: https://github.com/vllm-project/vllm-omni/blob/main/recipes/fishaudio/Drama-3.md
