1471 次浏览 · 5 赞 · 0 转发 (收录时)
Artificial Analysis 将六项能力指数更新至 v2.0
- 谁
- Artificial Analysis
- 时间
发生了什么
Artificial Analysis 将六项能力指数更新至 v2.0,使其与 Artificial Analysis Intelligence Index v5.0 的评测保持一致,并更加重视非幻觉能力和智能体工具使用。Claude Opus 5.5 (max) 在六项指数中均居首;权重尚未发布的 Kimi K3.1 Pro 是开源权重模型中的领先者,排名介于第 5 至第 8 位。
接下来读什么
查看这件事的完整进展Artificial Analysis 将六项能力指数更新至 2.0 版We’ve updated the six Artificial Analysis Capability Indexes to v2.0, aligning them with evaluations from the Artificial Analysis Intelligence Index v5.0 and placing greater emphasis on Non-Hallucination and Agentic Tool Use
The Capability Indexes map tasks from O*NET occupations to benchmarks that represent them, weighting each benchmark by how often its capability appears in that occupation. There are six indexes: Finance & Accounting, Strategy & Ops, Legal, Healthcare & Medical, Engineering, and Economics.
Key changes:
➤ Finance & Accounting: increased weight on Non-Hallucination, upgraded HLE to HLE-Diamond and AA-Omniscience to v1.1, removed GDPval-AA from Agentic Knowledge Work, and removed AA-LCR from Long-Context
➤ Strategy & Ops: increased weight on Agentic Tool Use, added Non-Hallucination and upgraded AA-Omniscience to v1.1, removed GDPval-AA from Agentic Knowledge Work, and removed AA-LCR from Long-Context
➤ Legal: increased weight on Non-Hallucination, upgraded HLE to HLE-Diamond and AA-Omniscience to v1.1, removed GDPval-AA from Agentic Knowledge Work, and removed AA-LCR from Long-Context
➤ Healthcare & Medical: increased weight on Agentic Tool Use, upgraded HLE to HLE-Diamond and AA-Omniscience to v1.1, and removed GDPval-AA from Agentic Knowledge Work
➤ Engineering: added Science as a new capability sourced from CritPt v2 (Hard Subset) and Terminal-Bench-Science 0.1, added FrontierCode 2.0 to Agentic Coding, upgraded HLE to HLE-Diamond and AA-Omniscience to v1.1, and removed GDPval-AA from Agentic Knowledge Work
➤ Economics: increased weights on Agentic Knowledge Work and Long-Context Reasoning, replaced AA-LCR with GDP.pdf in Long-Context Reasoning, upgraded HLE to HLE-Diamond and AA-Omniscience to v1.1, and removed GDPval-AA from Agentic Knowledge Work
Key results:
➤ Claude Opus 5.5 (max) leads in all six indexes, followed by GPT-6 Astra (max) in Finance & Accounting, Legal, and Engineering
➤ Among open weights models, Kimi K3.1 Pro (weights not yet released) leads all six indexes, at #5 to #8. MiniMax-M3.1-Flash leads in Strategy & Ops (#10), and DeepSeek V4.1 Flash 1017 (max) leads Healthcare & Medical (#12)
这件事到目前为止
Artificial Analysis 将六项能力指数更新至 2.0 版,使其与 Artificial Analysis Intelligence Index 5.0 版的评测保持一致。修订后的指数更加重视非幻觉表现和智能体工具使用能力。 Claude Opus 5.5 (max) 在六项指数中均排名第一。Kimi K3.1 Pro 在开放权重模型中领先,排名第五至第八;其权重尚未发布。
每天一封,跟上 AI 的重要变化
模型发布、价格变化、算力进展,附原始来源。免费,确认后开始发送,随时一键退订。 看一份往期日报 · 2026-11-04
