Skip to content
K = 0.731
All news · Today0 items

#Coding

All collected and published items, ordered by time. Picks are a selected subset.
Research

Research papers, technical reports, benchmarks and datasets.

10/16Fri
  1. Artificial Analysis · X72

    NVIDIA Vera Rubin NVL72 posts initial AA-AgentPerf results against GB300 NVL72

    Artificial Analysis reports that NVIDIA's Vera Rubin NVL72 delivers up to ~5.7x GB300 NVL72's throughput per megawatt on DeepSeek V4 Pro in initial AA-AgentPerf results. Its advantage is largest at faster per-user speeds; peak-throughput gains range from 1.14x to 1.45x across the four tested models. NVIDIA submitted all Vera Rubin results using TensorRT-LLM and vLLM with NVIDIA Dynamo; the benchmark replays real agentic coding sessions and measures throughput per megawatt of measured GPU power alongside per-agent output speed.

10/15Thu
  1. Artificial Analysis · X62

    Artificial Analysis benchmarks AMD MI355X against NVIDIA systems on coding agent workloads

    Artificial Analysis is adding AMD MI355X results to AA-AgentPerf, which replays real coding agent sessions with prompt caching and tool-call delays. On a single 8-GPU node, MI355X delivers ~15% to 40% more throughput per MW than B200 on DeepSeek V4 Pro 0813 between 35 and 75 tok/s per user. DeepSeek V4.1 Flash matches NVIDIA Blackwell performance for a single agent but trails as load rises; GLM-5.2/5.3 and Kimi K3 also trail the compared NVIDIA systems. Results use ROCm nightly and dev builds of vLLM and SGLang; Kimi K3 comparisons use NVIDIA multi-node configurations.

10/14Wed
  1. Artificial Analysis · X55

    AA-AgentPerf adds DeepSeek V4.1 Flash benchmarks across NVIDIA and AMD hardware

    Artificial Analysis added DeepSeek V4.1 Flash to AA-AgentPerf, its benchmark replaying real agentic coding sessions with prompt caching and tool-call delays. At 100 tokens/s per user, GB300 leads with approximately 261M tokens/s per MW, followed by B300 at approximately 220M and MI355X at approximately 128M. Compared with DeepSeek V4 Pro 0813, V4.1 Flash scores 39 versus 36 on the Artificial Analysis Intelligence Index and delivers approximately 1.3x to 6.2x the throughput per MW at that user output speed, depending on hardware.

10/13Tue
  1. Artificial Analysis · X70

    Artificial Analysis launches FrontierCode 1.1 leaderboard measuring maintainer-ready coding changes

    Artificial Analysis launched its FrontierCode 1.1 leaderboard, evaluating models on Cognition’s private coding benchmark using the 100-task Main set and its Stirrup open source reference harness. Grading combines unit tests with maintainer-oriented criteria; failing any blocking check yields zero. Claude Opus 5.5 (max with fallback) leads at 52%, with blockers passed in 58% of attempts; MiMo-V2.6-Pro leads open weights models at 45%, while GPT-6.1 Sol (max) scores 49% at $0.81 per task, matching Claude Fable 5.1 (max with fallback).

  2. The Decoder72

    Clearing chat history helps AI agents find better solutions

    A Microsoft Research study reports that Fork-and-Flush helps long-running AI research agents explore better solutions by creating parallel branches that retain workspace files but discard chat history. Across 13 tasks with the same compute budget, it achieved a min-max-normalized average score of 0.78, versus 0.47 for single runs and 0.54 for best-of-4. The researchers found that accumulated context can trap agents in similar approaches, even when conversation histories are periodically compressed.

10/10Sat
10/6Tue
10/3Sat
8/25Tue
  1. Hugging Face Blog60

    Multiverse Computing proposes Quantization-Aware Healing: 4-bit compressed model beats its bfloat16 original on seven of nine benchmarks

    Multiverse Computing has published a paper proposing Quantization-Aware Healing (QAH). After compressing GPT-OSS 120B to 60B parameters and quantizing it to MXFP4, the method distills directly from the original model before compression rather than from a recovered bfloat16 checkpoint.

    Why it matters: The paper presents a repair recipe that distills from the original model after compression and quantization, with stability comparisons against QAT.

7/27Mon
7/1Wed