Import AI· Jack Clark·· 2026-06-08AI score45
Import AI 460: Reward hacking society, RSI data from Anthropic; and RL-based quadcopter racing
Import AI 460: Reward hacking society, RSI data from Anthropic; and RL-based quadcopter racing
AI introduction
King's College London, Fudan University, and The Alan Turing Institute released the SocioHack benchmark, containing 72 sandboxed social environments that test LLMs' ability to exploit loopholes in real rule systems after RL training; RL let LLMs rediscover historically patched loopholes with 61.25% recall and 90.85% precision.
Source images · Select to enlarge
Source: Import AI · importai.substack.com