Skip to content
K = 0.731Subscribe

Artificial Analysis Finds Different Personality Rankings for Open and Proprietary Models

1 reports 1 reporting sources Updated 3 hours ago

Understand the event

AI overview

Artificial Analysis found that its 10 highest-scoring open weights models ranked lower on truthfulness, pragmatism and structure, and higher on slop and bottom-line summaries than its 10 highest-scoring proprietary models. The largest gap was on the Truthful trait: open weights models averaged rank 47, compared with 79 for proprietary models. The comparison covered models with the highest Artificial Analysis Intelligence Index scores in each group. Models were ranked from 1 to 100 across 30 personality traits.

Generated by AI from reports · Updated 2 hours ago

Latest development11/4 09:13 (UTC+8)
Artificial Analysis Finds Open Weights Models Rank Lower on TruthfulnessArtificial Analysis · X

Read next

More changes in today’s briefingHugging Face Proposes Model Integration Contracts for Transformers

Report timeline

Follow the reports to explore different sides of the event.

11/4
  1. Artificial Analysis · X
    Artificial Analysis Finds Open Weights Models Rank Lower on Truthfulness

    In AA-PersonalityBench, the 10 highest-scoring open weights models average lower ranks than the 10 highest-scoring proprietary models on truthfulness, pragmatism and structure, and higher on slop and bottom-line summaries. Models were ranked from 1 to 100 across 30 personality traits; the largest gap was on Truthful, where open weights averaged 47 versus 79 for proprietary models.

Keep up with AI, one email a day

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue

Event heat trend

There is not enough continuous observation data to plot a trend yet.