Import AI 460: social rules can be reward-hacked, Anthropic's RSI data, and RL drone racing
This issue of Import AI summarizes three studies. Researchers from King's College London, Fudan University, and the Alan Turing Institute built SocioHack, a benchmark with 72 sandboxed social environments testing whether AI can game rules in scenarios such as credit-card rewards and school grading. LLMs trained with RL rediscovered patched vulnerabilities in historical environments with 61.25% recall and 90.85% precision.
