12.3K views · 144 likes · 18 reposts (at collection)
vLLM v0.31.0 ships with DeepSeek-V4.1-Flash support and fast restart
What happened
vLLM v0.31.0 is live, spanning 717 commits from 307 contributors, including 96 first-timers. Highlights include DeepSeek-V4.1-Flash support with FlashMLA mega attention and NVFP4 KV caching, a vllm preload fast-restart path that keeps weights in GPU memory, Model Runner V2 speculative decoding, and large-scale serving features such as MoonEP balanced all-to-all and DeepEPv2. Full release notes are on GitHub.
ReasoningOpen sourceDeployment engineeringProduct updates#Product update#Deployment and engineering#Open source#Reasoning
Keep reading
Latest daily · Issue 24NVIDIA and AI4Bharat Introduce Nemotron-pretraining-Indic-v1 and an Open Data Generation PipelineTrending now
- 1Meta Releases Muse Spark Open With Mac and Cloud Support, Topping US Open-Weight Index
- 2Google Launches Gemini 4 Argon Globally, Expands Paid Access as Benchmark Results Vary
- 3OpenAI Updates GPT-6 Astra Pro in ChatGPT With Parallel Agents and Faster Responses
- 4Meta’s New Business Terms Raise Dispute Over Website Crawling and AI Training Rights
Tomorrow at 08:00, a briefing like this arrives in your inbox.
The same kind of briefing as the one above: a few stories worth reading. Free. Mail starts after you confirm, and every letter has a one-click unsubscribe. Read a past issue · 2026-10-17