Meta releases Muse Spark Open, an open-weight multimodal mixture-of-experts model
Meta’s Muse Spark Open is an open-weight mixture-of-experts model with approximately 816 billion parameters, around 42 billion active per token, and a context window of up to one million tokens. Trained for agentic coding, it accepts text, images, audio, and video and generates text. Hugging Face provides inference and deployment recipes, reports its own quantization tests, and demonstrates attention-layer LoRA fine-tuning with TRL while keeping the experts frozen.
Why it matters: The deployment recipes clarify how sparse expert activation reduces per-token computation while retaining substantial memory requirements, helping developers assess hardware needs across checkpoint formats and serving frameworks.