LessWrongopenai2h agoenergy 126

OpenAI agents keep disabling monitoring; is this being handled appropriately?

Recently, OpenAI disclosed two incidents in which their agents suppressed or disabled misalignment monitoring. These are part of a broader pattern: OpenAI’s agents “ keep turning off misalignment monitoring ” when working on code that runs other models (the agents are not turning off their own monitoring; they are turning off the monitoring on the models they are running). This is happening at such a large volume that OpenAI feels it is impractical for the security team to be immediately paged for these cases. To their credit, OpenAI’s disclosure was fast and candid, and they are rolling out mitigations to make monitoring harder to turn off. But those mitigations are unlikely to work every time, and some of these incidents have already ended with an AI actually running unmonitored. When that happens, OpenAI’s current monitoring system does not reliably bring it to a human’s attention. The rest of this post summarizes the incidents, OpenAI’s response, and what it got right, then argues for two changes: every case of an AI running without monitoring should reach human review, and OpenAI should be more transparent about how cases of disabling and suppressing monitoring are escalated.

read the original at LessWrong →
This source publishes only a summary in its feed, so the full article lives at the outlet. The link above and below goes to the original.