Skip to content
K = 0.731

Artificial Analysis Says Announced AA-Omniscience and GDPval-AA v2 Scores Are Not Comparable to Its Results

1 reports 1 reporting sources 2 hours agoNew

Understand the event

AI overview

Artificial Analysis said an announcement’s scores for AA-Omniscience and GDPval-AA v2 do not follow its methodology and are not comparable to scores published by Artificial Analysis. It also clarified that the announcement did not refer to its Intelligence Index. Artificial Analysis said AA-Omniscience uses a private dataset.

Generated by AI from reports · Updated 1 hours ago

Latest development10/20 03:04 (UTC+8)
Artificial Analysis Says AA-Omniscience Scores Aren’t Comparable to Its ScoresArtificial Analysis · X

Report timeline

Follow the reports to explore different sides of the event.

10/20
  1. Artificial Analysis · X
    Artificial Analysis Says AA-Omniscience Scores Aren’t Comparable to Its Scores

    Note that this is not our Intelligence Index. The announcement also referred to scores for AA-Omniscience and GDPval-AA v2, which do not follow our methodology and are not comparable to scores on Artificial Analysis. AA-Omniscience uses a private dataset (though we open sourced https://t.co/H1by1NvcgB

Tomorrow at 08:00, a briefing like this arrives in your inbox.

The same kind of briefing as the one above: a few stories worth reading. Free. Mail starts after you confirm, and every letter has a one-click unsubscribe. Read a past issue

Event heat trend

There is not enough continuous observation data to plot a trend yet.

Keep reading

Latest daily · Issue 26VAST open-sources EdenLive world model with over 24FPS generation at 720P