Skip to content
Original
ProductsvLLM · XFrom the source· @vllm_project·· 2 hours agoPicks

1.4K views · 31 likes · 4 reposts (at collection)

vLLM adds day-0 support for Mistral Large 4

Who
vLLM
What
adds day-0 support for Mistral Large 4, including FP8 and NVFP4 checkpoints and a built-in DSpark drafter

What happened

vLLM announces day-0 support for MistralAI's Mistral Large 4, a trillion-parameter multimodal MoE with 1M context for advanced coding, reasoning, and cybersecurity-related tasks. FP8 and NVFP4 checkpoints, with a built-in DSpark drafter. https://twitter.com/1667249535519805451/status/2115811242556137820

Why it matters

The checkpoint formats and built-in DSpark drafter provide concrete deployment context for developers considering serving Mistral Large 4 with vLLM.

Read next

See the full storyMistral Releases Large 4 Open Weights With Licensing Conditions and Launch-Day Inference Support

The story so far

Mistral AI released improved open weights for Mistral Large 4, also called Le Chonk, with launch-day inference support from NVIDIA and vLLM. Mistral says its license allows free use, modification, fine-tuning and commercialization, but businesses operating Model-as-a-Service offerings must obtain a separate license before commercial use. The Decoder describes that exception more narrowly as covering companies offering Large 4 as a commercial cloud service, and reports that access requires review and contractual restrictions. The multimodal model targets agentic coding and cybersecurity. Artificial Analysis lists 1.05 trillion total parameters and 52 billion active parameters, and says it narrowly leads open-weight models developed outside China. Mistral reports a 48% Artificial Analysis Coding Agent Index score using 47% fewer tokens per task than GLM-5.3, and first place among open models on Cognition’s FrontierCode. Those coding claims have a different scope from the overall Artificial Analysis score of 26 reported by The Decoder, which places it behind several Chinese rivals. NVIDIA announced NVFP4 weights on Hugging Face and an optimized Dynamo configuration for distributed inference. vLLM added support for FP8 and NVFP4 checkpoints with a built-in DSpark drafter, and describes the model as supporting a 1-million-token context.

Keep up with AI, one email a day

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue · 2026-10-29