1.8K views · 33 likes · 5 reposts (at collection)
vLLM reports decode performance within 6% of DeepInfer on AgentX
- Who
- vLLM
- What
- claimed Wide-EP and EPLB can match DeepInfer’s decode performance within 6% and generate $39 per GPU per hour at DeepSeek’s off-peak pricing on the AgentX workload
- When
What happened
vLLM says Wide-EP and EPLB let it match DeepInfer’s decode performance within 6% and generate $39/gpu/hr in revenue at DeepSeek’s off-peak pricing, at 200 P90 TPS on the AgentX workload. The post links to further details at.
Links in the post: 1The story so far
vLLM said its Wide-EP and EPLB configuration can achieve decode performance within 6% of DeepInfer on the AgentX workload at 200 P90 TPS. Under those same workload and performance conditions, vLLM said it can generate $39 per GPU per hour in revenue using DeepSeek’s off-peak pricing.
Keep reading
Latest daily · Issue 28Mistral AI releases Voxtral 3 speech models and a voice agent SDKTrending now
- 1Mistral Releases Voxtral 3 Speech Models, Voice Agents API and LiveKit-Based SDK
- 2DeepSeek Open-Sources DeepInfer and API Components, With Model and Hardware Limits
- 3OpenAI Acquires Orchestra Bio to Expand AI Tools for Drug Development
- 4Google Rolls Out Gemini Personal Intelligence to Android Auto, With Google Built-In Cars to Follow
Tomorrow at 08:00, a briefing like this arrives in your inbox.
The same kind of briefing as the one above: a few stories worth reading. Free. Mail starts after you confirm, and every letter has a one-click unsubscribe. Read a past issue · 2026-10-21