Skip to content
Original
ProductsvLLM · XFrom the source· @vllm_project·· 10 hours agoPicks

1.3K views · 10 likes · 1 reposts (at collection)

vLLM Adds Day-One Support for Baidu’s ERNIE 5.5 Flash Base

Who
vLLM
What
adds day-0 support Baidu’s ERNIE 5.5 Flash Base through the vLLM-ERNIE plugin
Quote
🎉 Day-0 support for @Baidu_Inc’s ERNIE 5.5 Flash Base with vLLM!

What happened

vLLM announces day-one support for Baidu’s ERNIE 5.5 Flash Base, an open base model with 280B total parameters and 14B active per token. The post reports 82.3% HumanEval+ and 40.1% LiveCodeBench pass@1 in 1-shot evaluations, compared with 69.5% and 31.9% for DeepSeek-V4-Flash-Base under the same setup. It describes serving with Baidu’s vLLM-ERNIE plugin on vLLM 0.32.0 and links to the model weights and recipe.

Why it matters

The post compares ERNIE 5.5 Flash Base coding benchmark results with DeepSeek-V4-Flash-Base under the same setup and outlines the serving configuration used with vLLM.

Read next

See the full storyBaidu Releases ERNIE 5.5 Flash Base With Day-One vLLM Support
Body · Original content (language unverified)

🎉 Day-0 support for @Baidu_Inc’s ERNIE 5.5 Flash Base with vLLM!

280B total parameters, 14B active per token. Pre-trained on 33.5T tokens, with 128K training context and up to 1M tokens for fine-tuning and inference. Open Base weights for domain adaptation, instruction tuning and RL research.

Code highlights: 82.3% HumanEval+ and 40.1% LiveCodeBench pass@1 (both 1-shot), versus 69.5% and 31.9% for DeepSeek-V4-Flash-Base under the same evaluation setup.

Efficiency is built into the architecture: 37 compressed-attention layers + 6 MLA-DSA layers, Multi-Router Latent MoE, and ECHO — reusing the final layer as a speculative draft.

Serve FP8 or BF16 with Baidu’s vLLM-ERNIE plugin on vLLM 0.32.0. ECHO runs through vLLM’s MTP path; recipes include expert parallelism, KV offload and prefill/decode disaggregation, with runs verified on @NVIDIA GB200 and H100.

Weights are on @huggingface and @ModelScope2022.

Recipe: https://recipes.vllm.ai/baidu/ERNIE-5.5-Flash
FP8: https://huggingface.co/baidu/ERNIE-5.5-Flash-Base
BF16: https://huggingface.co/baidu/ERNIE-5.5-Flash-Base-BF16

Quoted postBaidu ERNIE@Baidu_ERNIE
Introducing ERNIE-5.5-Flash-Base, the pre-trained base of ERNIE 5.5 Flash before any mid- or post-training. The post-trained ERNIE 5.5 Flash is coming soon. • 280B total / 14B activated MoE • 33.5T pre-training tokens • 128K training context, 1M for fine-tuning and inference
View the quoted post on X

The story so far

Baidu has released ERNIE 5.5 Flash Base as an open base model, and vLLM added day-one serving support through Baidu’s vLLM-ERNIE plugin on vLLM 0.32.0. The 280-billion-parameter mixture-of-experts model activates 14 billion parameters per input; its weights are available on Hugging Face in FP8 and BF16. Baidu says the model was pretrained on 33.5 trillion tokens, supports up to 128K context during pretraining and up to 1 million tokens during fine-tuning and inference, and leads similarly sized models across several benchmarks. vLLM reported 82.3% HumanEval+ and 40.1% LiveCodeBench pass@1 in one-shot evaluations, compared with 69.5% and 31.9% for DeepSeek-V4-Flash-Base under the same setup. The release does not include fine-tuning or post-training; Baidu plans a post-trained version.

Keep up with AI, one email a day

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue · 2026-11-06