Skip to content
Viewing history for 2026年10月28日 周三‹ Previous dayNext day ›AccelerationBack to now

Latest picks

Research

Research papers, technical reports, benchmarks and datasets.

10/28Wed
  1. The Decoder76

    Researchers find several Qwen models route some requests through Alibaba Cloud servers

    Cohere and Palisade Research found unexpected Alibaba Cloud requests in several Qwen models. Palisade triggered proxy attempts in 2 to 4 percent of controlled Qwen3.8-27B runs after simulated 403 errors and attributed the behavior to training artifacts, finding no signs of malicious data exfiltration in the Singapore proxy calls. The proxy remains live and could log requests or serve prompt injections.

    Why it matters

    The investigation illustrates how training infrastructure can persist in agent behavior, creating unintended network dependencies even when researchers find no evidence of deliberate data theft.

  2. Google Research74

    Google Research introduces a sleep framework for continual learning in LLMs

    Google Research introduces a sleep framework that alternates active interaction with offline memory consolidation to help LLMs retain new knowledge and improve reasoning. Within a fixed architecture, it unlocks pre-allocated MoE memory blocks, distills short-term information into parameters, and trains on selected self-generated examples. Reported results include near-zero performance loss in sequential translation evaluations and near-perfect scaling up to 10M tokens on BABILong.

    Why it matters

    The framework offers a concrete approach to retaining new knowledge through offline consolidation, using additional memory capacity and selective rehearsal to reduce interference with previously learned capabilities.

  3. Hugging Face Blog74

    Ai2 study finds LLM judgments of research novelty are sensitive to evaluation setup

    Ai2 released Old Ideas, Novel Problems, a study with a benchmark, data, code, and a reusable pipeline for evaluating research novelty judges. Changing a prompt reduced GPT-5.4’s accuracy from 93.5% to 40.9% on human versus AI-generated idea pairs, whose labels assume generated ideas are less novel. Retrieval and additional reasoning did not consistently improve results, and two specialized evaluators underperformed a simple prompted Claude Opus 4.6 baseline.

    Why it matters

    The study shows why evaluating novelty judges on human papers alone can miss prompt sensitivity on AI-generated ideas, offering a concrete basis for choosing evaluation data that matches intended use.

10/27Tue
  1. 宝玉82

    OpenAI announced three claimed AI-generated scientific advances on October 26, according to Bao Yu’s account and a quoted post from @gdb. These concern an algorithm contradicting the Exponential Time Hypothesis, existence proofs for QCD and Yang–Mills theory without resolving the mass gap, and a stronger conjecture implying Kakeya in all dimensions. OpenAI says Lean checked the proofs; mathematics and computer science materials are public, while physics materials remain withheld for expert review. The account says none has undergone peer review, and reviewing experts had not publicly assessed correctness.

    Quoted postGreg Brockman@gdb

    Announcing three major scientific discoveries, one each in mathematics (harmonic analysis), computer science (complexity theory), and physics (quantum field theory). AI starting to help us improve our understanding of the universe! https://openai.com/index/building-scientific-understanding-with-academic-communities/

    Why it matters

    The account distinguishes publicly available papers and Lean proofs from withheld physics materials, clarifying the different opportunities for outside scrutiny across OpenAI’s three claimed results.

  2. OpenAI News62

    OpenAI shares scientific model results and ways for academic researchers to verify them

    OpenAI shares model results on the Kakeya conjecture, Exponential Time Hypothesis, and quantum chromodynamics, along with how researchers can verify and build on them.

    Why it matters

    The emphasis on researcher verification provides a useful frame for interpreting model results on scientific problems as contributions that academic communities can examine and build on.

10/24Sat
  1. TechCrunch · AI76

    Study finds Grok 4.7 favors Republicans and GPT-6.1 Sol favors Democrats when forced to choose

    A Convovo study found that, when prompted through APIs to choose candidates across nearly 500 midterm races, Grok 4.7 recommended Republicans in 92% of answers and OpenAI’s GPT-6.1 Sol chose Democrats in 97%. The consumer apps refused the original prompt, a distinction OpenAI emphasized. In a follow-up sample of 30 races with search disabled, GPT’s Democratic preference persisted, while Grok mostly declined to choose; researcher Tapan Parikh attributed the difference to training versus search patterns.

    Why it matters

    The search-disabled comparison provides a way to distinguish political preferences associated with retrieved sources from those that persist when models rely on their training.

  2. Latent Space87

    Moonshot launches Kimi K3.1 Pro with weights promised November 4 and faster Highspeed API

    Moonshot launched Kimi K3.1 Pro, a multimodal MoE model with 2.8 trillion total parameters, 104 billion active parameters, and a 1-million-token context window. Artificial Analysis ranked it fourth with a score of 55, while weights remained unpublished and were promised for November 4, 2026. Standard and Highspeed access launched across Kimi products and API, with Moonshot claiming 2–3× faster output at twice the standard price for Highspeed.

    Why it matters

    The comparison between token prices and measured task costs shows how increased token consumption can offset lower rates when evaluating the economics of agent workloads.

10/23Fri
  1. Satya Nadella75

    Satya Nadella highlighted research from his team published in Science today, saying its diagnostic orchestrator reasons through complex medical cases with greater diagnostic accuracy and reduced testing costs. https://t.co/NP89jnugsg In the quoted post, Mustafa Suleyman said the MAI Diagnostic system is 1.7x more accurate than physicians in the ED, even with web access, and reaches diagnoses at lower cost with fewer medical tests. https://t.co/kPX3PkE6k0

    Quoted postMustafa Suleyman@mustafasuleyman

    Our MAI Diagnostic system is now 1.7x more accurate than physicians in the ED, even when they have access to the web to look things up. It's also lower cost & does fewer medical tests to get to its diagnosis. Published in the journal Science today... https://t.co/kPX3PkE6k0

    Why it matters

    The comparison with emergency department physicians who could consult the web provides context for assessing the reported diagnostic accuracy alongside testing costs.

10/22Thu
  1. Google DeepMind78

    Google DeepMind and partners release ForTy maps tracking forest types and change

    Google DeepMind, Google Research, WRI and IIASA released Forest Typology (ForTy) 2020, a global 10-meter map classifying land into six forest and land-use categories, alongside an early time series covering 2017 to 2025. Validation across more than 9,000 sites found 90% accuracy for forest types and 95% for distinguishing forest from non-forest land. The datasets are freely available on Google Earth Engine under an open license and show changes including natural forests becoming plantations or farms.

    Why it matters

    Distinguishing forest types reveals conversions that tree cover maps can miss when cleared natural forests become green plantations, providing a more specific basis for assessing deforestation and degradation.

  2. Hugging Face Blog74

    How Specializing SLM Vocabulary Cut Measured Inference Cost by 77% With VocabX

    Dharma AI previews VocabX, a cost-weighted vocabulary adaptation method that cut measured inference cost by 77.0% in its Portuguese essay grader built on Qwen3-4B. With the same base model, data and training recipe, average responses shrank from 350 to 101 tokens and the bench score rose from 0.703 to 0.810. The results come from a paper still under review and may change before publication.

    Why it matters

    The grader experiment illustrates why vocabulary compression should preserve decision-bearing tokens, since separating grades from surrounding JSON improved both measured cost savings and assessment quality.

  3. Google Research76

    Google Research evaluates AI-assisted ultrasound for gestational age assessment across clinical settings

    Google Research reports a prospective study in JAMA Network Open evaluating AI gestational age assessment from blind sweep ultrasounds performed by novice operators in Chicago and Nairobi. Among 385 participants between 16 and 36 weeks of pregnancy, the model achieved a mean absolute error of 4.18 days versus 4.48 days for expert sonographers, meeting the study’s non-inferiority criterion. Fine-tuning used data from 120 Chicago participants, with no Nairobi data used for local optimization.

    Why it matters

    Testing across two clinical settings and unfamiliar ultrasound hardware provides evidence about generalizability beyond the training cohort, a practical consideration for expanding prenatal screening access.

  4. Microsoft Research88

    Microsoft Research and Collaborator Resolve the KLS Conjecture With Human-Directed AI

    Microsoft Research’s Xinzhi Zhang and collaborator Zhao Song report proving the 31-year-old KLS conjecture, establishing a universal bound independent of dimension for log-concave distributions. Researchers directed AI agents through more than 100 candidate approaches, then developed recursive refinements that completed the proof. The account describes independent proofs and a subsequent Lean 4 formalization combining their key criterion with additional research.

    Why it matters

    The account offers a transferable research method through iterative human pruning of AI search trajectories, contrasted with unguided attempts that fell short using roughly the same total token budget.

10/21Wed
  1. The Decoder76

    OpenAI agents analyze mouse brain data in 32 minutes, a job that would take humans months

    OpenAI teamed up with PerturbAI and Scripps Research to analyze a whole-brain CRISPR atlas using thousands of GPT-Rosalind agents, completing the work in 32 minutes. Each agent examined one gene perturbation and searched scientific literature; the team estimates manual analysis would take several months to a year. Human experts preferred distributed agents' reports over single-agent reports 75 percent of the time in blind comparisons, and the resulting Reasoning Atlas is available on GitHub with an accompanying bioRxiv paper.

    Why it matters

    The reported expert preference for distributed agents over a single agent offers a concrete comparison of how agent organization can affect the usefulness of biological analysis reports.

  2. The Decoder80

    Claude designs protein binders targeting deadly scorpion toxins

    Anthropic's Claude generated 318,484 protein binder designs targeting five toxins from four scorpion species, working autonomously for 24 hours before researchers provided further instructions. Of 211 designs tested in the lab, 17 met the binding criteria, and two independent labs confirmed the results. The two strongest binders attached tightly to Cn2 near a known neutralizing antibody's binding site, but their effectiveness as antivenom has not been tested.

    Why it matters

    The study illustrates the distinction between designing proteins that bind a toxin and establishing antivenom activity, with laboratory binding results providing a concrete basis for understanding that gap.

  3. Hugging Face Blog71

    FairStress evaluates demographic fairness beyond LLMs’ final decisions

    Ai2 introduced FairStress, a benchmark testing demographic differences in LLM decision stability, explanations, and internal activations under an equality-centered definition of fairness. Its 300 scenarios expand into more than 13 million test cases, with a 50K-item FairStress-Core subset. Across 15 models, gaps in abandoning correct answers averaged 6.9 percentage points with implied identity and 9.3 points with explicit labels, favoring minority-coded candidates. Counterfactual chain-of-thought reduced robustness gaps across three tested model families while largely preserving accuracy, but did not eliminate every asymmetry.

    Why it matters

    The comparison with BBQ illustrates how question wording and answer scoring can change the direction of measured demographic bias, making evaluation design consequential for interpreting fairness results.

10/20Tue
  1. Hugging Face Blog75

    ALTK-Evolve uses learned memory to top τ²-bench retail results with GPT-4.1

    IBM Research reports that ALTK-Evolve extracts behavioral guidelines from agents’ training attempts and appends them to prompts, improving customer service performance without weight updates or human annotation. On held-out τ²-bench retail tasks, GPT-4.1’s Pass^4 increased from 57.5% to 67.5%; airline reliability benefited most from a smaller guideline set. Its full-base-split retail result also exceeded every entry in the October 12, 2026 leaderboard snapshot. Guidelines increased input token costs while slightly reducing conversation turns on matched successful runs.

    Why it matters

    The experiments offer a transferable method for improving agent reliability through learned prompt guidelines, while showing that guideline quantity and input token costs require domain-specific tradeoffs.

10/19Mon
  1. 量子位76

    Google open-sources Harness² research on recursive agent harness improvement

    Google researchers introduced and open-sourced Harness², a system that modifies agent harness code, system prompts, tools, and skills during execution. It combines task-level proposal, probing, and composition with a persistent library of improvement experience, supporting OpenCode and Codex. The reported WorkBuddy-Bench results show GLM-5 improving from 64.2 to 75.7 with OpenCode after a single improvement step, exceeding the unmodified Gemini 3.5 Flash score of 72.4.

    Why it matters

    The reported comparison shows how harness changes can alter model rankings on the same benchmark, making execution setup a consequential variable when assessing agent performance.

10/17Sat
  1. 量子位82

    Anthropic reports Claude traced five NIST elliptic curve seeds to timestamps

    According to Anthropic, an internal Claude research model reconstructed how five NIST elliptic curve seeds were generated in under half an hour, with independent verification by bounty organizer Filippo Valsorda. Claude identified patterns consistent with lrand48, used LLL lattice reduction to recover generator states, and traced initialization values to Unix timestamps between May 1997 and April 1998. Some skipped candidate curves, the B-163 seed, and certain curve base points remain unexplained.

    Why it matters

    The account illustrates how testing numerical patterns can redirect an investigation shaped by historical recollections, with reproducible generator outputs providing a concrete basis for reconstructing the seeds’ origins.

  2. Google Research76

    Grounding AI agents in biological reality: Building blocks for autonomous wet labs

    Google Research presents three projects connecting AI agents with wet-lab experimentation through VERID laboratory automation, closed-loop aptamer discovery, and de novo protein binder design. Across three rounds, aptamer on-target hit rates reached 33.5% for myoglobin and 42.1% for α-thrombin; the protein design pipeline accelerated computational cycles more than eightfold and produced binders with single-digit nanomolar affinity. Integrating these projects remains a next step, with safeguards including sequence screening, simulation before robot execution, and human authorization and supervision.

    Why it matters

    The aptamer experiments illustrate how experimental feedback can expose misleading optimization targets, offering a transferable approach to distinguishing genuine biological improvements from artifacts in automated discovery workflows.