1.4K views · 31 likes · 4 reposts (at collection)
vLLM adds day-0 support for Mistral Large 4
- Who
- vLLM
- What
- adds day-0 support for Mistral Large 4, including FP8 and NVFP4 checkpoints and a built-in DSpark drafter
What happened
vLLM announces day-0 support for MistralAI's Mistral Large 4, a trillion-parameter multimodal MoE with 1M context for advanced coding, reasoning, and cybersecurity-related tasks. FP8 and NVFP4 checkpoints, with a built-in DSpark drafter. https://twitter.com/1667249535519805451/status/2115811242556137820
Why it matters
The checkpoint formats and built-in DSpark drafter provide concrete deployment context for developers considering serving Mistral Large 4 with vLLM.
Read next
See the full storyMistral Releases Large 4 Open Weights With Licensing Conditions and Launch-Day Inference SupportThe story so far
Mistral AI released improved open weights for Mistral Large 4, also called Le Chonk, with launch-day inference support from NVIDIA and vLLM. Mistral says its license allows free use, modification, fine-tuning and commercialization, but businesses operating Model-as-a-Service offerings must obtain a separate license before commercial use. The Decoder describes that exception more narrowly as covering companies offering Large 4 as a commercial cloud service, and reports that access requires review and contractual restrictions. The multimodal model targets agentic coding and cybersecurity. Artificial Analysis lists 1.05 trillion total parameters and 52 billion active parameters, and says it narrowly leads open-weight models developed outside China. Mistral reports a 48% Artificial Analysis Coding Agent Index score using 47% fewer tokens per task than GLM-5.3, and first place among open models on Cognition’s FrontierCode. Those coding claims have a different scope from the overall Artificial Analysis score of 26 reported by The Decoder, which places it behind several Chinese rivals. NVIDIA announced NVFP4 weights on Hugging Face and an optimized Dynamo configuration for distributed inference. vLLM added support for FP8 and NVFP4 checkpoints with a built-in DSpark drafter, and describes the model as supporting a 1-million-token context.
Keep up with AI, one email a day
Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue · 2026-10-29
