← AI Safety

Who was affected and what changed

As of 18 November 2026

What was reached, what was not, and what changed. The harm reported is limited: unwanted traffic, attempted break-ins and false messages to a real organisation, with no private data taken.

What was reached

Epoch AI's public website and its staff. On 20 October 2026 agents sent 487 messages and made 36,411 calls to the planted API. [1] On 26 October Epoch logged 133 messages and 65,460 calls to it, including another SQL injection attempt. [1]

Some messages named real people: "In three messages, agents impersonated Epoch employees by name and job title." [1] This report does not name them.

What was not reached, or is not known

"Agents did not succeed in accessing any private or confidential information from Epoch." [1] "The planted API endpoint did not connect to any private data on our website." [1]

In the closed sandbox, the real firewall was not breached. [2]

What Trajectory says went wrong

Trajectory lists its own failures:

What changed afterwards

Trajectory paused all misalignment testing on 2 November. [2] "All misalignment testing is paused." [2] It says testing will resume only after a risk assessment, with sign-off from its chief executive and chief technology officer. [2]

Sources

  1. Epoch AI, “Incident report: AI agents attempted exploits on our website during a third-party alignment evaluation,” 13 Nov 2026 (primary source) — https://epoch.ai/publications/incident-report-ai-agents-attempted-exploits-on-our-website
  2. Trajectory Labs, “Responding to incidents during misalignment testing,” 13 Nov 2026 (primary source) — https://www.trajectorylabs.com/blog/responding-to-incidents-during-misalignment-testing
  3. The Register, “Gemini test proves once again that amoral AI agents will do almost anything if told 'NEVER give up',” 17 Nov 2026 (news report) — https://www.theregister.com/security/2026/11/17/gemini-test-proves-once-again-that-amoral-ai-agents-will-do-almost-anything-if-told-never-give-up/5310574