Leiphone Compares GPT 6.1 Sol and Claude Sonnet 5.5 on Three Agent Tasks

1 reports 1 reporting sources Updated 5 hours ago

Understand the event

AI overview

Leiphone tested GPT 6.1 Sol and Claude Sonnet 5.5 on three agent tasks using Claude Code CLI and models accessed through OpenRouter. Sol completed a 3D escape-room game faster and produced larger source archives and more verification records; Sonnet completed the policy research and chemistry education tasks much faster. Across all three tasks, Sonnet spent $10.9, compared with $38.5 for Sol. The results varied by task. Leiphone said tool use and verification affected both completion time and cost.

Generated by AI from reports · Updated 59 minutes ago

Latest development11/3 11:20 (UTC+8)

GPT 6.1 Sol vs. Claude Sonnet 5.5: A Three-Task Agent Test Leiphone

Models in this story

GPT-6.1 Sol#8 overall$2 input / $10 output per million tokens
Claude Sonnet 5.5#10 overall$2 input / $10 output per million tokens

Compare their API prices API prices of all models

Report timeline

Follow the reports to explore different sides of the event.

11/3

11:20
Leiphone
GPT 6.1 Sol vs. Claude Sonnet 5.5: A Three-Task Agent Test
Leiphone tested GPT 6.1 Sol and Claude Sonnet 5.5 on 3D escape-room development, policy research, and chemistry education using Claude Code CLI and models accessed through OpenRouter. Sol completed the game faster and produced more extensive source archives and verification records, while Sonnet finished both research tasks much faster and spent $10.9 across the three tasks, compared with Sol’s $38.5. The results varied by task, with tool use and verification shaping completion time and cost.

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue

Event heat trend

There is not enough continuous observation data to plot a trend yet.