vLLM adds day-0 support for NVIDIA Nemotron 3.5 Super VL

What happened

🎉 Day-0 support for NVIDIA Nemotron 3.5 Super VL in vLLM! 120B total parameters, 12B active per token, and a 1M-token context window. Text, images, documents and video in one open multimodal model, with reasoning and tool use for agent workflows. Here is what is supported and how to get started. 🧵 1/4

The story so far

NVIDIA released Nemotron 3.5 Super VL and Nemotron 3.5 Bolt 74B-A9B 24GB, and both are now available on Ollama. A smaller Bolt E4B 4GB model is scheduled for Oct. 23. Super VL is an open multimodal model with 120 billion total parameters and 12 billion active parameters. It combines reasoning and tool use with text, image, document and video understanding for agent workflows. NVIDIA released its weights, datasets and training recipes. vLLM added launch-day support and lists a 1-million-token context window; Red Hat AI also released open FP8 and DSpark optimized checkpoints. Bolt 74B-A9B targets local agent tasks and uses native 2-bit quantization to fit in 24GB of memory. NVIDIA says it is optimized for RTX Spark and designed to run alongside other applications. It is also available on Hugging Face, with support for llama.cpp, LM Studio, Unsloth and vLLM.

Keep reading

Trending now

1. 1Meta Releases Muse Spark Open With Mac and Cloud Support, Topping US Open-Weight Index
2. 2Google Launches Gemini 4 Argon Globally, Expands Paid Access as Benchmark Results Vary
3. 3OpenAI Updates GPT-6 Astra Pro in ChatGPT With Parallel Agents and Faster Responses
4. 4Meta’s New Business Terms Raise Dispute Over Website Crawling and AI Training Rights