Skip to content

Arena Creative Writing

LMArena · People choose between anonymous stories, poems and other creative writing to assess whether the work engages readers.
Across e/accCounts toward ranking
Evidence budget5%
Upstream data time10/15 08:00
Last successful sync10/17 08:05

What it measures and how

Read the creative_writing category in the official text_style_control dataset, using style-controlled Bradley–Terry scores and confidence intervals. Do not substitute overall text or professional-writing scores.

How this evidence is used

Counts toward ranking. Receives 5% from the original 10% human-preference budget; overall text keeps 5%, with no increase in total budget. Shares the evidence family with other Arena tasks.

Benchmark results

Fixed rules select one representative configuration per public model. Anonymous test models are omitted. Original source ranks are retained, with up to 30 models per benchmark.

Source rankSource model nameRaw resultRepresentative configuration
1Claude Opus 5.5 (High)Anthropic1,519.1High reasoning
2Gemini 4 Argon (High)Google1,515.6High reasoning
3Claude Fable 5 (High)Anthropic1,501.3High reasoning
4Claude Opus 4.6 (High)Anthropic1,499.7High reasoning
5Gemini 3.7 Flash (High)Google1,491High reasoning
6Claude Opus 4.7 (High)Anthropic1,489High reasoning
7Gemini 3.8 Flash (High)Google1,486.9High reasoning
8Muse Wonder (Max)Meta1,485.1Max reasoning
9Claude Fable 5.1 (Max)Anthropic1,484.7Max reasoning
10Gemini 3 ProGoogle1,484.6Source default configuration
12Gemini 3.1 Pro PreviewGoogle1,481Source default configuration
15gemini-3.6-flash-highGoogle1,471High reasoning
16Claude Opus 5 (Max)Anthropic1,471Max reasoning
17claude-opus-4-5-20251101-high-32kAnthropic1,469.4High reasoning · 32k
18claude-opus-4-8-highAnthropic1,469.1High reasoning
19qwen3.8-maxAlibaba1,469Source default configuration
20gpt-5.6-sol-xhighOpenAI1,468.6xHigh reasoning
22claude-sonnet-5.5-xhighAnthropic1,465.1xHigh reasoning
23Muse SparkMeta1,465Source default configuration
24gemini-3.5-flash-highGoogle1,464.3High reasoning
25grok-4.20-beta1xAI1,463.2Source default configuration
27Kimi K3 (Max)Moonshot AI1,461.3Max reasoning
29Muse Spark 1.3 (Max)Meta1,461.2Max reasoning
30gpt-6.1-sol-maxOpenAI1,458.4Max reasoning
31gemini-3-flashGoogle1,456.8Source default configuration
32gpt-5.5-instantOpenAI1,454.5Source default configuration
33glm-5.2-maxZ.ai1,454.5Source default configuration
35glm-5.3-maxZ.ai1,453.2Source default configuration
36grok-4.5xAI1,451.7Source default configuration
37gpt-5.5-highOpenAI1,451.3High reasoning
Limitations and attribution

Open user prompts are classified automatically; they are not all long-form fiction or Chinese creative writing. Votes include personal preferences. Overlap with Arena overall text and professional writing prevents it from counting as another independent organization.

Data license: CC BY 4.0 · Official Arena Hugging Face leaderboard-dataset; retain attribution and source links and disclose aggregation changes.

Results are published by LMArena. Raw scores and the e/acc consensus index use different scales and cannot be added directly.