AI2 releases Olmo-core 3, open and scalable training infrastructure for large MoE models
Introducing Olmo-core 3: Open, scalable training infrastructure for large MoEs
- Who
- hugging-face
- When
What happened
AI2 released Olmo-core 3, a major upgrade to its large language model development framework. It redesigns the open MoE training system to scale MoE training to trillions of parameters while maintaining compute efficiency.
Why it matters
The source provides throughput and memory comparisons for the MoE training stack, helping readers assess changes in the cost of large-scale MoE training.
Hugging FaceOpen sourceDeployment engineeringData and trainingProduct updates#Product update#Open-source ecosystem#Data and training#Deployment and engineering#Hugging Face
Keep reading
Latest daily · Issue 24NVIDIA and AI4Bharat Introduce Nemotron-pretraining-Indic-v1 and an Open Data Generation PipelineTrending now
- 1Meta Releases Muse Spark Open With Mac and Cloud Support, Topping US Open-Weight Index
- 2Google Launches Gemini 4 Argon Globally, Expands Paid Access as Benchmark Results Vary
- 3OpenAI Updates GPT-6 Astra Pro in ChatGPT With Parallel Agents and Faster Responses
- 4Meta’s New Business Terms Raise Dispute Over Website Crawling and AI Training Rights
Tomorrow at 08:00, a briefing like this arrives in your inbox.
The same kind of briefing as the one above: a few stories worth reading. Free. Mail starts after you confirm, and every letter has a one-click unsubscribe. Read a past issue · 2026-10-17