Baidu Open-Sources ERNIE 5.5 Flash Base

Baidu has open-sourced ERNIE 5.5 Flash Base, a 280-billion-parameter MoE base model with 14 billion parameters activated per token. Baidu says it was pretrained on 33.5 trillion tokens, supports up to 128K context during pretraining and up to 1 million tokens during fine-tuning and inference, and achieved top results among models of similar size across several benchmarks. The model is available on Hugging Face: https://huggingface.co/baidu/ERNIE-5.5-Flash-Base

Baidu open-sourced ERNIE 5.5 Flash Base on November 5, reporting state-of-the-art results among same-size models across knowledge, reasoning, math, coding, multilingual, and long-context benchmarks. The model uses a mixture-of-experts architecture with 280 billion total parameters and 14 billion active per token; its pretraining used 33.5 trillion tokens. The article describes attention, expert routing, and training changes intended to improve resource efficiency.