跳到正文
原文
模型Artificial Analysis · X· @ArtificialAnlys·· 7 天前

833 次浏览 · 4 赞 · 0 转发 (收录时)

Kimi K3.1 Pro 在 Artificial Analysis Cyber Index 中领先可公开使用的模型

谁
Artificial Analysis
时间
引文
Kimi K3.1 Pro is the new #1 openly-available model for agentic cyber defense, behind only trusted-access model GPT-6 Sol (Daybreak Blue) on the Artificial Analysis Cyber Index

发生了什么

Artificial Analysis 报告称,Kimi K3.1 Pro 在 Cyber Index 中得分为 64%,领先可公开使用的模型,但低于需经可信访问的 GPT-6 Sol(Daybreak Blue,max,69%)。该指数通过三项基准测试衡量智能体网络防御能力,主要使用公共 API;安全拒绝可能拉低得分。K3.1 Pro 没有遇到安全拒绝,但其每项任务成本为 $2.81,尽管每 token 价格低 33%,仍比 Kimi K3 高 15%。

接下来读什么

查看这件事的完整进展修订后的 Artificial Analysis 指数将 Kimi K3.1 Pro 排在第九位,该模型正式发布
正文 · 中文版本尚未就绪(原文)

Kimi K3.1 Pro is the new #1 openly-available model for agentic cyber defense, behind only trusted-access model GPT-6 Sol (Daybreak Blue) on the Artificial Analysis Cyber Index

@Kimi_Moonshot's Kimi K3.1 Pro scores 64% on the Artificial Analysis Cyber Index, 7 points ahead of the previous leading openly-available model, DeepSeek V4.1 Flash 1017 (57%), and 5 points behind GPT-6 Sol (Daybreak Blue, max, 69%), which is only available through OpenAI's trusted-access program. Once the weights for K3.1 Pro are released, K3.1 Pro will also be the leading open weights model for cyber defense.

The Artificial Analysis Cyber Index measures capability on agentic cyber defense tasks and is composed of three benchmarks: CWE-Bench-AA, DeepsecBench-AA and CyberGym-E2E-AA. The Index primarily evaluates models through their publicly accessible APIs, reflecting the cyber capabilities available to developers.

Proprietary models from OpenAI, Anthropic and Google may have stronger cyber capabilities but lose points to safety refusals: GPT-6 Sol (Daybreak Blue, max), available through OpenAI's trusted-access program, scores 32 points above its public counterpart. Kimi K3.1 Pro encounters no safety refusals.

Key results:

➤ #1 openly-available model and #2 overall: Kimi K3.1 Pro scores 64%, up 23 points from Kimi K3 (41%) and ahead of DeepSeek V4.1 Flash 1017 (57%). Only the trusted-access GPT-6 Sol (Daybreak Blue, max, 69%) scores higher

➤ Highest CyberGym-E2E-AA score of any model: K3.1 Pro scores 95% on CyberGym-E2E-AA, placing it ahead of GPT-6 Sol (Daybreak Blue, 93%) and the next openly-available model, Mistral Large 4 (82%). On DeepsecBench-AA, K3.1 Pro scores 37%, behind GPT-6 Sol (Daybreak Blue, 48%) and GPT-6 Sol (46%). On CWE-Bench-AA it scores 61%, 4 points behind GPT-6 Sol (Daybreak Blue, 65%), with DeepSeek V4.1 Flash 1017 leading at 69%

➤ 15% increase in Cost per Task despite lower token prices: K3.1 Pro has a Cost per Task of $2.81, higher than GPT-6 Sol (Daybreak Blue, max, $1.77) and DeepSeek V4.1 Flash 1017 ($0.42). Kimi K3.1 Pro is 33% cheaper per token than Kimi K3 ($2/$10 vs. $3/$15 per 1M input/output tokens), but uses ~2x more input tokens, resulting in a 15% higher Cost per Task ($2.81 vs. $2.45)

这件事到目前为止

Moonshot AI 通过其应用和 API 发布了 Kimi K3.1 Pro,但尚未公开其模型权重;修订后的 Artificial Analysis Intelligence Index 现将其排在第九位,位于八款闭源模型之后。The Decoder 报道称,版本 5 将该指数的 60% 权重分配给私有测试集,以应对模型针对已知问题进行训练的情况。K3.1 Pro 得分为 46 分,比榜首低 12 分;在 4.3 版中,它以 55 分排名第四,比 Claude Opus 5.5 低 3 分。Ethan Mollick 提醒人们谨慎解读修订后的结果。Simon Willison 报道称,Moonshot 承诺在 2026 年 11 月 4 日前公开模型权重。 在 Artificial Analysis 单独发布的 Cyber Index 中,K3.1 Pro 得分为 64%,在公开可用模型的智能体网络防御能力方面领先;但仍落后于获准访问的 GPT-6 Sol(Daybreak Blue,max),后者得分为 69%。Artificial Analysis 表示,K3.1 Pro 在该指数的三项基准测试中均未触发安全拒绝。其单项任务成本为 2.81 美元,尽管每个 token 的价格低了 33%,但仍比 Kimi K3 高 15%。 Willison 报道称,标准 API 价格为每百万输入 token 2 美元、每百万输出 token 10 美元。Moonshot 表示,Highspeed 变体的运行速度快两到三倍;Willison 报道称,其费用是标准版的两倍,但输入 token 缓存命中仍按标准价格计费。

每天一封,跟上 AI 的重要变化

模型发布、价格变化、算力进展,附原始来源。免费,确认后开始发送,随时一键退订。 看一份往期日报 · 2026-10-30