Skip to content
K = 0.731

Nathan Lambert Defends the AAv5 Index and Open Models

1 reports 1 reporting sources 3 hours agoNew

Understand the event

AI overview

Nathan Lambert defended the AAv5 index and open models in a post on X, arguing that benchmarking is messier, more opinionated, and trickier than most people give it credit for.

Generated by AI from reports · Updated 2 hours ago

Latest development10/28 18:21 (UTC+8)
Nathan Lambert Defends the AAv5 Index and Open ModelsNathan Lambert · X

Read next

More changes in today’s briefingGoogle DeepMind announces Genie 4 for real-time world simulation with native audio

Report timeline

Follow the reports to explore different sides of the event.

10/28
  1. Nathan Lambert · X
    Nathan Lambert Defends the AAv5 Index and Open Models

    I feel a need to defend the AAv5 index and open models at the same time. Benchmarking is messier, more opinionated, and trickier than most people give credit to.

Keep up with AI, one email a day

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue

Event heat trend

Current within comparable coverage
9
Peak within comparable coverage
1010/28 19:00 (UTC+8)
24-hour change
–

Trends compare the same continuously observed participants, which may cover fewer sources than current heat. Point or click to inspect hourly heat, or use left and right arrow keys.