NVIDIA Nemotron 3.5 Transcribe arrives with day-0 vLLM and NeMo Speech serving

What happened

vLLM announces day-0 serving for NVIDIA Nemotron 3.5 Transcribe through vLLM + NeMo Speech. 40 languages. Recordings up to an hour. Promptable transcripts, speaker labels and audio Q&A. Open weights in BF16, FP8 and NVFP4.

Read next

• More changes in today’s briefingGoogle DeepMind announces Genie 4 for real-time world simulation with native audio

The story so far

NVIDIA released Nemotron 3.5 Transcribe, an open-weight speech model, with vLLM announcing launch-day serving support through vLLM and NeMo Speech. NVIDIA described it as a promptable 30B mixture-of-experts model with approximately 4B active parameters that combines transcription in 40 languages, speaker attribution, translation, contextual prompting and audio understanding in one checkpoint. The Decoder reported that the model follows text instructions to process recordings up to an hour long with up to eight speakers, but does not support real-time processing. vLLM said its serving support includes promptable transcripts, speaker labels and audio question answering, with model weights available in BF16, FP8 and NVFP4 formats. According to The Decoder, NVIDIA also released Granary v2, a dataset containing about 844,000 hours of speech in 48 languages, along with dataset-building tools and fine-tuning guides.