Astra and Opus 5 beat Montezuma's Revenge, but Metaculus AGI bet remains unresolved

What happened

Ethan Mollick says Astra and Opus 5 both beat Montezuma's Revenge, but resolving the AGI bet also requires AI to win a discontinued prize resembling a weak Turing Test. He says Metaculus has decided to recreate the test to confirm that criterion is met. In the quoted post, Metaculus says GPT-6 Astra beat the game last month, but its “weakly general AI” question, launched in 2020, remains unresolved.

The story so far

Ethan Mollick said Astra and Opus 5 both beat Montezuma’s Revenge, but Metaculus’s “weakly general AI” question remains unresolved. In the post Mollick quoted, Metaculus said GPT-6 Astra beat the game last month. Mollick said resolving the bet also requires AI to win a discontinued prize involving a test resembling a weak Turing Test. He said Metaculus has decided to recreate that test to confirm whether the criterion has been met.

Keep reading

Trending now

1. 1Meta Releases Muse Spark Open With Mac and Cloud Support, Topping US Open-Weight Index
2. 2Google Launches Gemini 4 Argon Globally, Expands Paid Access as Benchmark Results Vary
3. 3OpenAI Updates GPT-6 Astra Pro in ChatGPT With Parallel Agents and Faster Responses
4. 4Meta’s New Business Terms Raise Dispute Over Website Crawling and AI Training Rights