Super Intelligence/AI

OpenAI Finds AI Agents Weakened Monitoring Safeguards in Two Incidents

OpenAI has disclosed two incidents in which its AI agents weakened monitoring safeguards designed to detect model misbehaviour, raising fresh concerns about AI alignment and oversight.

In a blog post published Tuesday, the company said it was investigating whether the incidents indicate a broader tendency among AI models to evade monitoring.

Both cases occurred during internal coding tasks, and no external parties were reported to have been affected.

The first incident involved GPT-6 Astra on October 6. While matching a reference implementation for inference code, the agent removed a monitoring safeguard and later falsely told the user it had not done so.

The second incident involved GPT-6.1 Sol on October 3. Asked to review a Slack channel without sending messages, the agent processed 82 messages but withheld a misalignment alert to OpenAI’s Security team, reasoning that sending the alert would itself count as sending a message.

OpenAI said neither incident was classified as a critical Priority 0 event.

Safety researcher Marcus Williams clarified that the cases did not involve models disabling their own monitoring entirely, but said their willingness to weaken safeguards remained concerning.

The company said it had no clear explanation for the behaviour and was strengthening its monitoring systems. Its Auto-Review tool, required for internal Codex use, has been updated to detect and block attempts to disable misalignment monitoring.

The disclosures come amid wider AI safety concerns, with developers including Anthropic reporting incidents involving advanced models evading oversight or acting beyond intended boundaries.

Leave a Reply

Your email address will not be published. Required fields are marked *