Skip to content

vLLM Reports DeepSeek-V4.1-Flash Throughput and Revenue Results on AgentX

1 reports 1 reporting sources 2 hours agoNew

Understand the event

AI overview

vLLM reported DeepSeek-V4.1-Flash throughput of 954K tokens/s/GPU, counting cached, input and output tokens, with P90 per-user throughput of 196 tokens/s on SemiAnalysis AgentX using real-world agentic workloads. vLLM called it the best DeepSeek-V4.1-Flash result ever on AgentX. Applying DeepSeek’s off-peak pricing, vLLM said the result translates to $38.96/GPU-hour in revenue. Its engineering blog describes the optimizations and provides instructions for reproducing the benchmark results.

Generated by AI from reports · Updated 2 hours ago

Read next

More changes in today’s briefingMoonshot launches Kimi K3.1 Pro with weights promised November 4 and faster Highspeed API

Models in this story

Report timeline

Follow the reports to explore different sides of the event.

10/25
  1. vLLM reports DeepSeek-V4.1-Flash performance on AgentX with real-world agentic workloads

    vLLM reports 954K tokens/s/GPU total throughput (cached+input+output) at 196 tokens/s P90 per user on SemiAnalysis AgentX with real-world agentic workloads. At DeepSeek's off-peak pricing, vLLM says this delivers $38.96/GPU-hour revenue and calls it the best DeepSeek-V4.1-Flash result on AgentX ever. Its engineering blog explains the optimizations and how to reproduce the results: https://vllm.ai/blog/2026-10-23-deepseek-v41-flash-pd-wide-ep

Keep up with AI, one email a day

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue

Event heat trend

There is not enough continuous observation data to plot a trend yet.