Artificial Analysis Introduces AA-PersonalityBench to Measure Language Model Personality and Communication

1 reports 1 reporting sources 2 hours agoNew

Understand the event

AI overview

Artificial Analysis introduced AA-PersonalityBench, a benchmark that evaluates language models across 30 personality traits and 21 communication characteristics using answers to 900 curated questions. The benchmark uses pairwise comparisons by LLM judges to assess personality traits and programmatic calculations to measure communication characteristics. As an example of the differences it measures, Artificial Analysis reported that Qwen3.8 27B averages about 1,030 words per response, while GPT-6 Luna averages 270.

Generated by AI from reports · Updated 1 hours ago

Latest development10/20 02:27 (UTC+8)

Artificial Analysis Announces AA-PersonalityBench for Measuring Language Model Personality Artificial Analysis · X

Models in this story

Qwen3.8 27 B$0.24 input / $2.2 output per million tokens
GPT-6 Luna$0.1 input / $0.5 output per million tokens

API prices of all models

Report timeline

Follow the reports to explore different sides of the event.

10/20

02:27
Artificial Analysis · X
Artificial Analysis Announces AA-PersonalityBench for Measuring Language Model Personality
Artificial Analysis introduced AA-PersonalityBench, a benchmark that measures language models across 30 personality traits and 21 communication characteristics. It evaluates answers to 900 curated questions, using pairwise comparisons by LLM judges for personality traits and programmatic calculations for communication characteristics. For example, Qwen3.8 27B averages about 1,030 words per response, while GPT-6 Luna averages 270.

The same kind of briefing as the one above: a few stories worth reading. Free. Mail starts after you confirm, and every letter has a one-click unsubscribe. Read a past issue

Event heat trend

There is not enough continuous observation data to plot a trend yet.

Keep reading

Latest daily · Issue 26VAST open-sources EdenLive world model with over 24FPS generation at 720P