Skip to content

Noam Brown Praises Dwarkesh Patel’s Blood on the Clocktower AI Benchmark

2 reports 1 reporting sources Updated 39 minutes ago

Understand the event

AI overview

Noam Brown praised the methodology of Dwarkesh Patel’s AI benchmark, which had models play the social deception game Blood on the Clocktower, and asked whether Patel wanted a job designing evaluations at OpenAI. Patel said he spent $20,000 in API credits on the benchmark and linked to clocktowerbench.com.

Generated by AI from reports · Updated 14 minutes ago

Read next

More changes in today’s briefingGoogle DeepMind Rolls Out Gemini Omni 1.2 Flash for Longer Video Generation

Report timeline

Follow the reports to explore different sides of the event.

11/6
  1. Noam Brown Praises Dwarkesh’s AI Social Deception Benchmark

    Noam Brown says he is impressed with the methodology of Dwarkesh’s benchmark and asks whether Dwarkesh wants to design evaluations at OpenAI. In the quoted post, Dwarkesh says he spent $20,000 in API credits having AI models play Blood on the Clocktower and links to the full benchmark at clocktowerbench.com.

  2. Noam Brown Praises @dwarkesh_sp’s Blood on the Clocktower AI Benchmark

    @dwarkesh_sp spent $20,000 in API credits having AI models play each other at Blood on the Clocktower, a social deception game. Noam Brown said he was impressed by the benchmark’s methodology and asked whether @dwarkesh_sp wanted a job designing evals at @OpenAI: https://twitter.com/dwarkesh_sp/status/2118449808402681911

Keep up with AI, one email a day

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue

Event heat trend

There is not enough continuous observation data to plot a trend yet.