3.8K views · 48 likes · 3 reposts (at collection)
NVIDIA Nemotron 3.5 Bolt 74B-A9B 24GB is now on Ollama
- Who
- Ollama
- What
- made available NVIDIA Nemotron 3.5 Bolt 74B-A9B 24GB
What happened
NVIDIA Nemotron 3.5 Bolt 74B-A9B 24GB is now on Ollama. This vision-language model (VLM) is designed to run everyday agentic tasks locally, using native 2-bit quantization to fit in 24GB of memory and run alongside other applications. ollama run nemotron-3.5-bolt
Why it matters
The stated memory footprint provides a concrete deployment consideration for running local agentic workloads alongside other applications on the same machine.
The story so far
NVIDIA released Nemotron 3.5 Super VL and Nemotron 3.5 Bolt 74B-A9B 24GB, and both are now available on Ollama. A smaller Bolt E4B 4GB model is scheduled for Oct. 23. Super VL is an open multimodal model with 120 billion total parameters and 12 billion active parameters. It combines reasoning and tool use with text, image, document and video understanding for agent workflows. NVIDIA released its weights, datasets and training recipes. vLLM added launch-day support and lists a 1-million-token context window; Red Hat AI also released open FP8 and DSpark optimized checkpoints. Bolt 74B-A9B targets local agent tasks and uses native 2-bit quantization to fit in 24GB of memory. NVIDIA says it is optimized for RTX Spark and designed to run alongside other applications. It is also available on Hugging Face, with support for llama.cpp, LM Studio, Unsloth and vLLM.
Keep reading
Latest daily · Issue 24NVIDIA and AI4Bharat Introduce Nemotron-pretraining-Indic-v1 and an Open Data Generation PipelineTrending now
- 1Meta Releases Muse Spark Open With Mac and Cloud Support, Topping US Open-Weight Index
- 2Google Launches Gemini 4 Argon Globally, Expands Paid Access as Benchmark Results Vary
- 3OpenAI Updates GPT-6 Astra Pro in ChatGPT With Parallel Agents and Faster Responses
- 4Meta’s New Business Terms Raise Dispute Over Website Crawling and AI Training Rights