4287 次浏览 · 20 赞 · 1 转发 (收录时)
Artificial Analysis 发现开放权重模型在真实性方面排名较低
- 谁
- Artificial Analysis
- 时间
- 引文
We compared the 10 open weights and 10 proprietary models measured with the highest Artificial Analysis Intelligence Index scores.
发生了什么
在 AA-PersonalityBench 中,得分最高的 10 个开放权重模型在真实性、务实性和结构性方面的平均排名低于得分最高的 10 个专有模型,而在废话和结论摘要方面的平均排名更高。模型根据 30 项个性特征从 1 到 100 排名;差距最大的是“真实”这一特征,开放权重模型的平均排名为 47,专有模型为 79。
接下来读什么
查看这件事的完整进展Artificial Analysis发现开源权重模型与专有模型的性格排名不同In AA-PersonalityBench, the top open weights models on average rank lower than the top proprietary models on truthfulness, pragmatism and structure, and higher on slop and summarizing the bottom line
We compared the 10 open weights and 10 proprietary models measured with the highest Artificial Analysis Intelligence Index scores. Each model is percentile ranked from 1 to 100 on each of 30 personality traits. On average, the top open weights models rank 32 points lower than the top proprietary models on Truthful, the largest gap of any trait.
Average rank, top proprietary vs. top open weights:
➤ Open weights rank lower: Truthful (79 vs. 47), Pragmatic (79 vs. 49), Natural Sounding (77 vs. 52), Evidence-Based (76 vs. 47), Structured (73 vs. 45) and Literate (70 vs. 47)
➤ Open weights rank higher: Slop (30 vs. 49), Bottom-Line Summary (47 vs. 62) and Scannable (41 vs. 53)
这件事到目前为止
Artificial Analysis发现,其得分最高的10个开源权重模型在真实性、务实性和结构性方面的排名低于得分最高的10个专有模型,在冗赘内容和总结要点方面的排名则更高。差距最大的是“真实”特质:开源权重模型的平均排名为47,专有模型为79。 这项比较涵盖了两组中 Artificial Analysis Intelligence Index 得分最高的模型。模型在30种性格特质上的排名范围为1至100。
每天一封,跟上 AI 的重要变化
模型发布、价格变化、算力进展,附原始来源。免费,确认后开始发送,随时一键退订。 看一份往期日报 · 2026-11-04
