Skip to content

Ethan Mollick Says Weight-Space Programming Claim Needs Replication

2 reports 2 reporting sources Updated 8 hours ago

Understand the event

AI overview

Ethan Mollick called a claim about editing model weights a big deal, while saying it still needs replication. The claim, posted by Rikiya Takehi, says GPT-6 Astra directly changed 0.016% of Qwen3.5-0.8B’s weights without gradients or training. The post says the edits fixed reasoning loops, improved math performance by up to 6x, and increased instruction following by 3x. Takehi calls the approach “Weight-Space Programming” and says frontier language models can read and write neural network weights. These results and broader claims are reported by Takehi; Mollick has not described them as independently confirmed.

Generated by AI from reports · Updated 3 hours ago

Read next

More changes in today’s briefingOpenAI’s updated Model Spec explained through its five core values

Models in this story

  • GPT-6 Astra#3 overall$10 input / $50 output per million tokens

Report timeline

Follow the reports to explore different sides of the event.

11/3
  1. Researchers Describe Weight-Space Programming for Editing Neural Network Weights

    A blog by four MIT CSAIL researchers describes Weight-Space Programming, in which GPT-6 Astra directly edited Qwen3.5-0.8B weights without training or gradients. The researchers report that changing 0.016% of weights raised MATH-500 accuracy from 7.9% to 48.1%, after Astra used 50 practice problems to address repetitive reasoning loops. They also report mixed results across game networks and say the findings have not been independently replicated.

  2. Ethan Mollick Flags Weight-Space Programming Claim as a Big Deal Pending Replication

    Waiting for replication but this is a pretty big deal. Quoted post by @rikiyatakehi: We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math. It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training. We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! 🧵 Blog: https://rikiyat.github.io/blog/weight-space-programming/

Keep up with AI, one email a day

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue

Event heat trend

Current within comparable coverage
8
Peak within comparable coverage
911/3 09:00 (UTC+8)
24-hour change
–

Trends compare the same continuously observed participants, which may cover fewer sources than current heat. Point or click to inspect hourly heat, or use left and right arrow keys.