Skip to content
K = 0.731
2026.10.17 · Sat

#评测/基准

#评测/基准

Research

Research papers, technical reports, benchmarks and datasets.

10/15Thu
  1. The Decoder81

    GPT-6-Astra solves 49 of 50 physics research problems at $2.40 apiece

    GPT-6-Astra, running in OpenAI's Codex environment without human hints, solved 49 of 50 TheoPhysEval problems across eleven theoretical physics subfields, costing just under $116 overall. Anthropic's Opus 5.5 scored 92 percent, while both models reached 92 percent without internet access. The researchers emphasize that the benchmark tests calculations using known methods, while choosing promising research questions remains a separate challenge for current agents.

    Why it matters: The benchmark distinguishes proficiency in concrete physics calculations from the ability to choose fruitful research questions, clarifying which parts of scientific work its high scores actually measure.

8/21Fri
  1. Hugging Face Blog60

    Hugging Face research measures benchmark optimization in speech recognition

    Hugging Face has published research measuring benchmark optimization in speech recognition through three tests: consensus disagreement, masked-entity retrieval, and spelling switches. The study evaluates 11 open-source ASR models.

    Why it matters: The study presents three reproducible probes and quantifies how often ASR models reproduce incorrect benchmark transcripts, with direct implications for evaluation design.

7/15Wed
  1. Hugging Face Blog62

    Hume releases Real World VoiceEQ to measure human quality in voice AI

    Hume has released Real World VoiceEQ, a benchmark for human quality in voice interaction. It covers more than 40 proprietary and open-source voice models, over 15 evaluation dimensions, and more than 60 metrics across ASR, TTS, speech-to-speech, and voice understanding.

    Why it matters: Hume built a voice-AI benchmark from more than a million human ratings, showing why current metrics can overestimate real conversational performance.

You've reached the end