Skip to content
K = 0.731
2026.10.17 · Sat

#评测/基准

#评测/基准

Models

New models and versions, open weights, and changes in capability and pricing, with their evaluations.

Today10/17Sat
  1. The Verge · AI77

    A week with Nvidia RTX Spark laptops reveals performance strengths and practical compromises

    The Verge’s three reviewers spent a week testing five Nvidia RTX Spark laptops, finding capable graphics and generally workable Windows on Arm apps alongside high prices, weaker CPU performance than Apple rivals, and demanding local AI workloads. Sean Hollister’s Asus ProArt P16 lasted roughly 5 hours to 5 hours and 40 minutes during everyday work. Their local AI experiments encountered substantial battery drain, heat, slow responses, and uneven results, despite configurations offering up to 128GB of unified memory.

    Why it matters: The hands-on comparisons show how large unified memory and capable graphics translate into everyday tradeoffs in local AI workloads, battery life, and software compatibility.

10/16Fri
  1. The Decoder78

    Google's Gemini 4 Argon is closer to the AI frontier than any Google model in months

    Google DeepMind’s Gemini 4 Argon scored 97.5 percent on ARC-AGI-3 using the Provider Adapter Harness at a cost of $4,800, behind GPT-6 Astra’s 99.9 percent. Its score fell to 49.8 percent at low reasoning in the Standard Harness, where API problems prevented completion of all games. Epoch AI placed Argon at 165 ECI points, close to Opus 5.5 and GPT-6 Astra, although early estimates ranked it eighth in math and sixth in software engineering.

    Why it matters: The comparison shows how testing environments can change benchmark standings, providing context for interpreting Argon’s proximity to leading models alongside its weaker math and software engineering results.

  2. Aravind Srinivas · X70

    Perplexity adds Gemini 4 Argon, citing a new WANDR benchmark high

    Aravind Srinivas says Gemini 4 Argon has set a new SoTA on the Wide-And-Deep-Research (WANDR) benchmark and is now available to all Perplexity users in fast search and Computer (agent) modes. https://t.co/0U671BhbMj The quoted @perplexity_ai announcement specifies availability for Pro and Max subscribers. https://t.co/n1TyI9RhBX

    Why it matters: The post identifies availability across fast search and Computer modes, while its broader access claim differs from the quoted announcement limiting availability to Pro and Max subscribers.

  3. Artificial Analysis · X79

    Meta releases Muse Spark Open, scoring 39 on Artificial Analysis Intelligence Index

    Meta has released Muse Spark Open, an 816B (42B active) open-weights model that Artificial Analysis reports scores 39 on its Intelligence Index, making it the #1 US open-weights model. Muse Spark Open (xhigh) scores 22 points above Muse Glimmer (high, 17), Meta's 30B dense open-weights model. https://t.co/jf31mQNINe

    Why it matters: The comparison places Muse Spark Open 22 points above Muse Glimmer on the same intelligence index, providing a concrete reference for the reported capability gap between Meta's open-weights models.

10/14Wed
  1. Artificial Analysis · X78

    Fish Audio’s Drama 3 Preview leads open-weights models in Artificial Analysis TTS rankings

    Artificial Analysis reports that Fish Audio’s Drama 3 Preview ranks #1 among open-weights models on all three of its Text to Speech leaderboards and leads all models in Pronunciation Robustness. It scores 93.2% on pronunciation robustness, ahead of Eleven v4 at 91.7% and Eleven v4 Turbo at 90.1%, while ranking #10 in Provider Voice and #14 in Controlled Voice. Its weights are available on Hugging Face under the Fish Audio Community License, and Fish Audio API pricing is $15/1M characters.

    Why it matters: The comparison separates pronunciation robustness from voice preference rankings, showing how Drama 3 Preview’s lead on one measure differs from its placement on others.

  2. Artificial Analysis · X87

    Gemini 4 Argon reaches GA, matching GPT-6 Astra on Artificial Analysis Intelligence Index

    Artificial Analysis reports that Gemini 4 Argon is now GA, matching GPT-6 Astra on its Intelligence Index at 60% of the Cost per Task under discounted pricing until November 30. Argon costs $1.99 per task and $2/$10 per 1M input/output tokens, rising to $4/$20 after November 30, with a 95% cache-read discount. Artificial Analysis also reports substantial agentic evaluation improvements and a 15% hallucination rate on AA-Omniscience, the lowest among models scoring 45+ on its Intelligence Index.

    Why it matters: The comparison separates intelligence scores from task costs, showing how Argon's temporary pricing affects its cost advantage over GPT-6 Astra at a comparable intelligence level.

10/13Tue
  1. Alexandr Wang · X82

    Meta releases Muse Wonder and Muse Wonder Full with higher benchmark scores

    Meta has released Muse Wonder and Muse Wonder Full, according to Artificial Analysis in the post quoted by Alexandr Wang. At max reasoning effort, they score 52 and 56 on the Artificial Analysis Intelligence Index v4.3, compared with Muse Spark 1.3’s 48, following a release gap of 6 weeks. Muse Wonder is available through Meta’s first-party API and Muse Code, while Muse Wonder Full is limited to Muse Code users; both have 1M-token context windows.

    Why it matters: Artificial Analysis’s comparison highlights a tradeoff between Muse Wonder’s improved benchmark performance and its higher cost per task relative to Muse Spark 1.3 despite lower output token usage.

  2. The Decoder83

    Meta releases Muse Wonder models with gains in coding and agent benchmarks

    Meta released Muse Wonder and Muse Wonder Full, scoring 52 and 56 on the Artificial Analysis Intelligence Index v4.3, versus 48 for Muse Spark 1.3. Both support a one-million-token context window and text, image, video, and audio inputs, with stronger coding and agent results but weaker factual knowledge than leading competitors. Muse Wonder is available through Meta's API and Muse Code at higher prices than its predecessor; Muse Wonder Full is currently limited to Muse Code users.

    Why it matters: The benchmark comparisons reveal a tradeoff between stronger coding and agent performance, weaker factual knowledge, and higher task costs, providing context for evaluating the models across different workloads.

10/11Sun
  1. 量子位78

    Google releases Nano Banana 2.1 image model with 4K output

    Google released Nano Banana 2.1, an upgraded image generation model with 4K output, mask-based editing and improved subject consistency. According to Arena, it gained about 61.7 points on average across text-to-image, multi-image editing and single-image editing, and Google halved API prices for 1K and 2K images while cutting 4K by about 25%. It is available in the Gemini app and Google AI Studio, with 50 free credits daily.

    Why it matters: The piece rounds up Arena ranking gains, API price cuts and early user tests of Nano Banana 2.1, including reported watermark and repeated-edit issues.

10/8Thu
  1. Simon Willison78

    Anthropic releases Claude Haiku 5.5 at GPT-6 Luna pricing

    Anthropic released the fast, low-cost Claude Haiku 5.5 at $0.10 per million input tokens and $0.50 per million output tokens, exactly matching GPT-6 Luna, released by OpenAI last month. Above 100,000 tokens, Haiku 5.5 rises to $0.50/$2.50, while Luna does not rise to $0.20/$0.75 until 272,000 tokens.

    Why it matters: The author tested Haiku 5.5 pricing, tokenizer changes, and the cost and latency of different reasoning tiers, offering a basis for weighing it against GPT-6 Luna.

10/1Thu
  1. The Decoder78

    Google releases Gemini 4 Argon, matching OpenAI and Anthropic but without a clear lead

    Google released frontier model Gemini 4 Argon, matching OpenAI and Anthropic on several benchmarks without a clear lead. It is initially available to 'trusted cyber defenders' in the Fairwind program and Google's internal teams before expanding to developers, businesses, and consumers. Promotional API pricing is $2 per million input tokens and $10 per million output tokens.

    Why it matters: This summary compares third-party and human-preference leaderboards, scores, token use, and pricing for Gemini 4 Argon against OpenAI and Anthropic.

9/30Wed
  1. 雷锋网78

    First hands-on tests of GPT-6 Astra: build Manhattan in a week, but long tasks still fail

    OpenAI released its next-generation flagship model GPT-6 Astra at 1 a.m. Beijing time on September 4. Leiphone compiled first-hand tests from users who received access early.

    Why it matters: Early user tests show GPT-6 Astra can check its own work on long tasks but still needs human oversight, revealing its capability limits.

You've reached the end