Vals AI Finds Deepseek V4.1 Flash Near GPT-6 on a Cyber Benchmark

1 reports 1 reporting sources Updated 3 hours ago

Understand the event

AI overview

Vals AI reported that Deepseek V4.1 Flash 1017 nearly matched GPT-6 Sol Daybreak on the Nova cyber benchmark and completed 21 of 31 objectives in the harder Lighthouse scenario, while Daybreak completed 27. CyberOffense simulates attacks on corporate networks to compare AI agents’ capabilities. The Decoder reported that a Nova run cost about $3 with Deepseek versus roughly $22 with Daybreak. Deepseek’s Lighthouse progress came mostly after 100 million tokens. The results are consistent with an AI Security Institute analysis that estimated a four-to-seven-month gap between open and closed models.

Generated by AI from reports · Updated 3 hours ago

Latest development11/7 23:35 (UTC+8)

Vals AI Benchmarks Show Open Models Closing the Cyber Capability Gap The Decoder

Models in this story

DeepSeek V4.1 Flash$0.051 input / $0.57 output per million tokens
DeepSeek V4.1 Flash 1017#19 overall$0.15 input / $0.6 output per million tokens
GPT-6 Sol#14 overall$2 input / $10 output per million tokens

API prices of all models

Report timeline

Follow the reports to explore different sides of the event.

11/7

23:35
The DecoderPicks
Vals AI Benchmarks Show Open Models Closing the Cyber Capability Gap
Vals AI’s CyberOffense benchmark finds that Deepseek V4.1 Flash 1017 approaches GPT-6 Sol Daybreak in the Nova test and completes 21 of 31 objectives in the harder Lighthouse scenario, compared with Daybreak’s 27. The report says Deepseek costs about $3 per Nova run versus roughly $22 for Daybreak, and that its Lighthouse progress came mostly after 100 million tokens. The results align with an AI Security Institute analysis that put the open and closed model gap at four to seven months.

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue

Event heat trend

Current within comparable coverage: 9
Peak within comparable coverage: 1011/8 00:00 (UTC+8)
24-hour change: –

Trends compare the same continuously observed participants, which may cover fewer sources than current heat. Point or click to inspect hourly heat, or use left and right arrow keys.