The 'Astra can read and write weights to improve Qwen' post is misleading(honnibal.dev)
1027 points by syllogism 8 days ago | 207 comments
tl;dr: The "Astra reads and writes weights to improve Qwen" post conflates distinct experiments: only small-network tasks (17K–172K weights) actually involve reading raw weights directly, while the headline Qwen math improvement relies on Astra writing Python code and running the model on up to 50 batches of practice problems. The impressive-sounding "no gradients, just weight editing" framing obscures that the LLM experiments are closer to automating what a human ML engineer would do with tools, not a unified capability for understanding weights directly.
HN Discussion:
  • ↑Expert confirms the original post oversells results and the real finding is just reducing reasoning loops
  • ↑The techniques described are not novel and resemble existing published work on activation steering
  • ↓The original post was clear if read fully; this rebuttal adds nothing new
  • ↓Weight-space programming remains genuinely impressive and novel regardless of the critique
  • •Speculation about future potential of models modifying weights for learning or self-improvement