Skip to content
K = 0.731Subscribe

Epoch AI Updates Its Capabilities Index with a Bayesian Method

1 reports 1 reporting sources Updated 49 minutes ago

Understand the event

AI overview

Epoch AI updated the Epoch Capabilities Index (ECI) to use a Bayesian methodology, which it said improves uncertainty estimates and makes model comparisons more accurate, including when individual uncertainty intervals overlap. Epoch AI said frontier model scores are largely unchanged.

Generated by AI from reports · Updated 35 minutes ago

Latest development11/5 05:31 (UTC+8)
Epoch AI Updates Epoch Capabilities Index with Bayesian MethodologyEpoch AI · X

Read next

More changes in today’s briefingHugging Face Proposes Model Integration Contracts for Transformers

Report timeline

Follow the reports to explore different sides of the event.

11/5
  1. Epoch AI · X
    Epoch AI Updates Epoch Capabilities Index with Bayesian Methodology

    We’ve updated the Epoch Capabilities Index (ECI) to use a Bayesian methodology. This improves uncertainty estimates and lets us compare models more accurately, even when their individual ECI uncertainty intervals overlap. Frontier model scores are largely unchanged: models https://t.co/VmHkorGjge

Keep up with AI, one email a day

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue

Event heat trend

There is not enough continuous observation data to plot a trend yet.