5.3K views · 55 likes · 9 reposts (at collection)
Artificial Analysis launches HealthBench and HealthBench Professional leaderboards
- Who
- Artificial Analysis
- What
- launches leaderboards for HealthBench and HealthBench Professional
- When
What happened
Artificial Analysis is launching leaderboards for OpenAI’s HealthBench and HealthBench Professional, reporting raw and length-adjusted scores on physician-created rubrics for realistic health conversations. GPT-6 Astra (max) leads HealthBench Professional at 66.0%, while Claude Sonnet 5.5 (max with fallback) leads HealthBench at 62.1%. Length adjustment penalizes replies exceeding 2,000 characters and boosts shorter replies; Claude Opus 5.5 (max with fallback) has the highest Professional raw score at 71.4% but drops to sixth at 59.9% after adjustment.
The story so far
Artificial Analysis launched leaderboards for OpenAI’s HealthBench and HealthBench Professional, with GPT-6 Astra (max) leading the length-adjusted Professional ranking at 66.0% and Claude Sonnet 5.5 (max with fallback) leading HealthBench at 62.1%. Both benchmarks evaluate AI responses to realistic health conversations using physician-created rubrics, and the leaderboards report raw and length-adjusted scores. The length adjustment penalizes responses exceeding 2,000 characters and boosts shorter responses, which can substantially change the rankings. Claude Opus 5.5 (max with fallback) has the highest raw HealthBench Professional score at 71.4%, but falls to sixth place at 59.9% after adjustment.
Keep reading
Latest daily · Issue 27TorchNeuron brings native PyTorch support for Hugging Face models on AWS TrainiumTomorrow at 08:00, a briefing like this arrives in your inbox.
The same kind of briefing as the one above: a few stories worth reading. Free. Mail starts after you confirm, and every letter has a one-click unsubscribe. Read a past issue · 2026-10-20