Granite Switch 4.1 Combines Chat, Decisions, and Speech in One Endpoint
Granite Switch 4.1: Chat, Decisions, and Speech from One Endpoint
- Who
- IBM
- What
- releases Granite-Switch-4.1-8B and Granite-Switch-4.1-30B models with decision and speech adapters
- Quote
Granite-Switch-4.1-8B and -30B are released with “batteries included”.
What happened
IBM released Granite-Switch-4.1-8B and -30B, combining chat, a general-purpose Decision aLoRA, a specialized Guardian aLoRA, and Granite-Speech-5.0-Turbo-CTC transcription through one hosted endpoint. IBM says the combined model uses approximately the same GPU VRAM as its base model, with adapters reusing the base model’s KV cache. Users can also compose custom Switch models from Granite Libraries adapters; an Adapter SDK for training adapters in Mellea is planned.
Why it matters
Shared KV caches and modular adapters offer a concrete approach to combining general and specialized decisions with transcription while keeping GPU memory use close to the base model.
The story so far
IBM released Granite-Switch-4.1-8B and Granite-Switch-4.1-30B, bringing chat, decision-making, safety checks, and speech transcription together through one hosted endpoint. The models include a general-purpose Decision aLoRA, a specialized Guardian aLoRA, and Granite-Speech-5.0-Turbo-CTC transcription. IBM says the combined model uses approximately the same GPU VRAM as its base model, with adapters reusing the base model’s KV cache. Users can also build custom Switch models with adapters from Granite Libraries. An Adapter SDK for training adapters in Mellea is planned.
Keep reading
Latest daily · Issue 24NVIDIA and AI4Bharat Introduce Nemotron-pretraining-Indic-v1 and an Open Data Generation PipelineTrending now
- 1Meta Releases Muse Spark Open With Mac and Cloud Support, Topping US Open-Weight Index
- 2Google Launches Gemini 4 Argon Globally, Expands Paid Access as Benchmark Results Vary
- 3OpenAI Updates GPT-6 Astra Pro in ChatGPT With Parallel Agents and Faster Responses
- 4Meta’s New Business Terms Raise Dispute Over Website Crawling and AI Training Rights