Artificial Analysis Launches HLE-Diamond Leaderboard, With Gemini 4 Carbon Leading

1 reports 1 reporting sources 2 hours agoNew

Understand the event

AI overview

Artificial Analysis launched its HLE-Diamond leaderboard as part of version 5 of the Artificial Analysis Intelligence Index, with Gemini 4 Carbon (high) leading at 69% and Claude Opus 5.5 (max) following at 68%. The evaluation uses a refined, 1,000-question version of Humanity’s Last Exam. Each question is run once without tools, and GPT-5.6 Luna (medium) judges answers using the official HLE judge prompt to calculate pass@1. Artificial Analysis reported that only 17 model variants—about 13%—scored above 50%, and that more than 90% performed better on reasoning than on knowledge.

Generated by AI from reports · Updated 1 hours ago

Latest development10/30 10:09 (UTC+8)

Artificial Analysis launches HLE-Diamond leaderboard, led by Gemini 4 Carbon Artificial Analysis · X

Models in this story

Claude Opus 5.5#1 overall$4 input / $20 output per million tokens
GPT-5.6 Luna$0.2 input / $1.2 output per million tokens

API prices of all models

Report timeline

Follow the reports to explore different sides of the event.

10/30

10:09
Artificial Analysis · X
Artificial Analysis launches HLE-Diamond leaderboard, led by Gemini 4 Carbon
Artificial Analysis launched its HLE-Diamond leaderboard as part of v5 of the Artificial Analysis Intelligence Index, evaluating a refined 1,000-question version of Humanity's Last Exam. Each question runs once without tools, with GPT-5.6 Luna (medium) judging answers using the official HLE judge prompt to report pass@1. Gemini 4 Carbon (high) leads at 69%, followed by Claude Opus 5.5 (max) at 68%; only 17 model variants (~13%) exceed 50%, and over 90% perform better on reasoning than knowledge.

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue

Event heat trend

There is not enough continuous observation data to plot a trend yet.