AI2 releases Olmo-core 3, open and scalable training infrastructure for large MoE models
AI2 released Olmo-core 3, a major upgrade to its large language model development framework. It redesigns the open MoE training system to scale MoE training to trillions of parameters while maintaining compute efficiency.
Why it matters: The source provides throughput and memory comparisons for the MoE training stack, helping readers assess changes in the cost of large-scale MoE training.

