382 views · 3 likes · 0 reposts (at collection)
vLLM v0.32.0 adds a structured-decision endpoint and low-precision KV updates
- Who
- vLLM
- What
- released vLLM v0.32.0
What happened
🚀 vLLM v0.32.0 is out! 814 commits · 363 contributors · 121 first-timers 🧭 New /v1/systemone structured-decision endpoint + generic hf tool/reasoning parser 🗜️ Low-precision KV everywhere: NVFP4 on SM8x/90/12x, FP8 KV default for GLM-5.x, 4-bit KV on ROCm 🛠️ Model Runner V2
Links in the post: 1Why it matters
The release details help deployment teams identify changes relevant to their hardware and model configurations, particularly through the listed low-precision KV options and GLM-5.x default.
The story so far
vLLM released v0.32.0, adding a /v1/systemone structured-decision endpoint, a generic hf tool/reasoning parser, and low-precision KV updates. The release adds NVFP4 KV support on SM8x/90/12x, makes FP8 KV the default for GLM-5.x, and adds 4-bit KV on ROCm. It also includes Model Runner V2.
Keep reading
Latest daily · Issue 25DeepSeek releases DeepSeek-V4.1-Flash-1017 on its website, app, and APITrending now
- 1DeepSeek Releases V4.1-Flash-1017, Now Available on Ollama Cloud With US Hosting
- 2Meta Removes Business Terms Language That Raised Website Scraping and AI Training Concerns
- 3Google DeepMind Says Four Gemini 4 Argon Agents Beat Minecraft Without Human Help
- 4Google Launches Gemini 4 Argon Globally, Expands Paid Access as Benchmark Results Vary
Tomorrow at 08:00, a briefing like this arrives in your inbox.
The same kind of briefing as the one above: a few stories worth reading. Free. Mail starts after you confirm, and every letter has a one-click unsubscribe. Read a past issue · 2026-10-18