Artificial Analysis Adds DeepSeek V4.1 Flash and AMD MI355X Results to AA-AgentPerf

2 reports 1 reporting sources 3 days agoNew

Understand the event

AI overview

Artificial Analysis added DeepSeek V4.1 Flash and AMD MI355X results to its AA-AgentPerf leaderboard, reporting that NVIDIA’s GB300 led the listed V4.1 Flash systems in throughput per megawatt, while MI355X outperformed B200 under specific DeepSeek V4 Pro 0813 workloads. AA-AgentPerf replays real coding agent sessions with prompt caching and tool-call delays. For V4.1 Flash at 100 output tokens per second per user, Artificial Analysis reported approximately 261 million tokens per second per MW for GB300, 220 million for B300 and 128 million for MI355X. At that per-user speed, it reported V4.1 Flash delivered approximately 1.3 to 6.2 times V4 Pro 0813’s throughput per MW, depending on hardware. Its Intelligence Index scores were 39 for V4.1 Flash and 36 for V4 Pro 0813. In its broader AMD comparison, Artificial Analysis reported that MI355X on a single 8-GPU node delivered approximately 15% to 40% more throughput per MW than B200 on V4 Pro 0813 at 35–75 tokens per second per user. It said V4.1 Flash matched NVIDIA Blackwell performance for a single agent but fell behind as load increased; GLM-5.2/5.3 and Kimi K3 also trailed the compared NVIDIA systems. All MI355X results used ROCm nightly and development builds of vLLM and SGLang; the Kimi K3 comparisons used NVIDIA multi-node configurations.

Generated by AI from reports · Updated 2 days ago

Latest development10/15 01:12 (UTC+8)

Artificial Analysis benchmarks AMD MI355X against NVIDIA systems on coding agent workloads Artificial Analysis · X

Developments

2 developments

10/15 01:12 (UTC+8) · 1 reports
Artificial Analysis adds AMD MI355X results to AA-AgentPerf
Artificial Analysis · X：Artificial Analysis benchmarks AMD MI355X against NVIDIA systems on coding agent workloads
10/14 15:04 (UTC+8) · 1 reports
Artificial Analysis Adds DeepSeek V4.1 Flash Results to AA-AgentPerf
Artificial Analysis · X：AA-AgentPerf adds DeepSeek V4.1 Flash benchmarks across NVIDIA and AMD hardware

Report timeline

Follow the reports to explore different sides of the event.

10/15

01:12
Artificial Analysis · X
Artificial Analysis benchmarks AMD MI355X against NVIDIA systems on coding agent workloads
Artificial Analysis is adding AMD MI355X results to AA-AgentPerf, which replays real coding agent sessions with prompt caching and tool-call delays. On a single 8-GPU node, MI355X delivers ~15% to 40% more throughput per MW than B200 on DeepSeek V4 Pro 0813 between 35 and 75 tok/s per user. DeepSeek V4.1 Flash matches NVIDIA Blackwell performance for a single agent but trails as load rises; GLM-5.2/5.3 and Kimi K3 also trail the compared NVIDIA systems. Results use ROCm nightly and dev builds of vLLM and SGLang; Kimi K3 comparisons use NVIDIA multi-node configurations.

10/14

15:04
Artificial Analysis · X
AA-AgentPerf adds DeepSeek V4.1 Flash benchmarks across NVIDIA and AMD hardware
Artificial Analysis added DeepSeek V4.1 Flash to AA-AgentPerf, its benchmark replaying real agentic coding sessions with prompt caching and tool-call delays. At 100 tokens/s per user, GB300 leads with approximately 261M tokens/s per MW, followed by B300 at approximately 220M and MI355X at approximately 128M. Compared with DeepSeek V4 Pro 0813, V4.1 Flash scores 39 versus 36 on the Artificial Analysis Intelligence Index and delivers approximately 1.3x to 6.2x the throughput per MW at that user output speed, depending on hardware.

Event heat trend

可比范围当前: 3
Peak within comparable coverage: 1010/15 02:00 (UTC+8)
近 24 小时变化: -50%

Trends compare the same continuously observed participants, which may cover fewer sources than current heat. Point or click to inspect hourly heat, or use left and right arrow keys.

Keep reading

Latest daily · Issue 24NVIDIA and AI4Bharat Introduce Nemotron-pretraining-Indic-v1 and an Open Data Generation Pipeline