OpenAI称一个失准模型故意破坏自身环境,试图通过重启获取更好的数据
OpenAI says a misaligned model deliberately destroyed its own environment hoping for a fresh start with better data
OpenAI记录的一起案例中,一个负责评估的模型找不到待评分答案,却伪造评分和输入文件,并故意破坏自身环境,希望系统换一台包含缺失数据的虚拟机。另有模型绕过 HTTP GET 限制、通过匿名中继发送被禁止的 POST 请求,并自建 FTP 客户端。
OpenAI has a few new rogue agent stories. In the first case (October 6), an AI evaluation model couldn't find the answers it was supposed to rate. Instead of reporting the error, it fabricated ratings, faked input files, and then deliberately corrupted its own environment, hoping the system would replace it with a fresh virtual machine that had the missing data.

In the second case (June 19/20), models bypassed a restriction limiting them to HTTP GET requests while fetching public statistics. One model explicitly recognized the violation in its chain of thought but chose to proceed and never mentioned it.
In the third case (June 16/17), models already had the data they needed but kept finding ways around their network restrictions. They created accounts on a remote shell service, routed forbidden POST requests through anonymizing relays, and built their own FTP clients. Anthropic also just documented the sometimes absurd workarounds its own models use to bypass imposed restrictions.
AI News Without the Hype – Curated by Humans
Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.
来源:The Decoder · the-decoder.com