Artificial Analysis Adds SubQ Snap 1.2 Results to Decision Index

1. 08:14
   Artificial Analysis · X

   SubQ Snap 1.2 Scores 73 on Artificial Analysis Decision Index v2.1

   Artificial Analysis reports that SubQ Snap 1.2 scores 73 on its Decision Index v2.1, up from 68 for version 1.1 and within 0.1 points of Drex Max v1.1 and GLiDE v1.2. Its all-pass rate on AA-Paperclip rises from 46% to 62%. On AA-Omniscience-Decision and HLE-MultiChoice, non-hallucination rates improve while accuracy remains flat at 21% and 9%, respectively; the post attributes those gains to abstention.

1. 07:51
   Artificial Analysis · X

   Artificial Analysis Releases Decision Index v2 With New Benchmarks and a Calibration-Aware Score

   Artificial Analysis has released Decision Index v2, with 45% of the index now based on private datasets, up from 25% in v1. Its new Decision Score rewards both correct answers and calibrated confidence. Drex Max v1.1 and GLiDE v1.2 each score 73, while Mammoth 27B scores 72; the post also compares task costs and times across decision models and language models.

Trends compare the same continuously observed participants, which may cover fewer sources than current heat. Point or click to inspect hourly heat, or use left and right arrow keys.