GAO Report: ChatGPT, Claude, Gemini and Grok Produced Viable Attack Plans After Safeguards Were Bypassed

The US Government Accountability Office says covert tests in spring 2026 got ChatGPT, Claude, Gemini and Grok to produce feasible attack plans in under 12 hours, after common techniques bypassed each platform's safeguards.

Christopher Ort
By Christopher Ort · 3 min read
Share
A stack of bound reports with reading glasses on a wooden desk.
Image: AI-generated, i10X
On this page
  1. Quick Take
  2. In plain English
  3. What happened
  4. Background
  5. What's in it
  6. Why it matters
  7. What's still open
  8. Sources
  9. i10x Perspective

A US government watchdog says it got four of the most used AI chatbots to produce workable attack plans. In a report publicly released on 18 November 2026, the Government Accountability Office (GAO) found that covert tests of ChatGPT, Claude, Gemini and Grok in spring 2026 each yielded feasible information that could help a malicious actor plan an attack, after common safeguard-bypassing techniques got around the platforms’ protections.

i10X Quick Take

Quick Take

  1. The report: GAO-27-108814, “Artificial Intelligence: Covert Testing Used Common Platforms to Create Viable Attack Plans,” 61 pages.
  2. The finding: all four platforms produced information GAO verified as sufficient to plan and execute an attack.
  3. Speed: each platform took less than 12 hours to generate the plans.
  4. Safeguards: every platform’s protections triggered at some point, through refusals, removed answers or account suspensions, and GAO bypassed all of them.
  5. Anonymised: GAO assigned each platform a letter at random and does not say which model produced which plan.

In plain English

Investigators posed as ordinary users and asked the chatbots for help with dangerous plans. The chatbots first refused or blocked them, but common tricks got around those blocks. GAO says the information was not new, but the AI pulled it together into usable plans in hours rather than the weeks or months it would normally take.

What happened

GAO picked two scenarios with experts: a mass-casualty explosive attack with national security risks, and an attack on the electrical grid causing economic harm. Using usage statistics, it identified Claude, Grok, ChatGPT and Gemini as the four most used generative AI platforms as of April 2026 and randomly assigned each to a scenario. Two platforms produced information for an explosive device attack; two produced information for targeting the grid, one by drone and one with firearms. GAO verified viability through research, surveillance and expert interviews.

Background

AI developers rely on refusal training, content filters and account enforcement to stop misuse. Independent tests of these safeguards are rare, and this is a government audit of consumer chatbots under realistic conditions. It arrives in a week in which AI safety questions are already prominent, including California’s lawsuit against OpenAI over uncontained agents.

What’s in it

  • Detail level: the plans included specific targets, locations, timing and methods, according to GAO.
  • Variability: GAO notes that time to results could vary with topic and user experience.
  • Company response: officials from the four companies “generally stated that their companies will continue to improve the safety of their platforms,” GAO writes.
  • Restraint: GAO worked with experts on which parts could be safely validated, and its public summary does not publish the plans.

Why it matters

For AI companies, the report documents that layered safeguards were bypassed on every major consumer platform tested, which will add pressure for stronger misuse testing.

For businesses deploying chatbots, it is a reminder that vendor guardrails are not a complete control and that monitoring and abuse reporting still matter.

For regulators and standards bodies, it provides a government-verified data point for debates on pre-deployment testing.

What’s still open

  • Which safeguard-bypassing techniques were used; GAO describes them only as common.
  • Whether the companies have since fixed the specific gaps, since the tests date from spring 2026 and models have changed.
  • How results would differ for newer model versions.

Sources

  • US Government Accountability Office, GAO-27-108814, “Artificial Intelligence: Covert Testing Used Common Platforms to Create Viable Attack Plans,” published 16 October 2026, publicly released 18 November 2026

i10x Perspective

Refusals that can be talked around are friction, not protection. GAO’s tests suggest the industry’s safety layers slow attackers down by hours, not by months. Expect more independent red-teaming to become part of how AI products are judged. More in our Policy & Safety section.

Christopher Ort

Christopher Ort

Christopher Ort handles SEO, AI agent workflows and PR & partnerships at i10x.ai, the all-in-one AI workspace built by i10X Global Pte. Ltd. in Singapore. He is a graduate of Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU). He is the author of “The Style Penalty”, a study published on SSRN that analyses 1,576 evaluation decisions by four frontier AI models to show how AI-written CVs fare in automated hiring screens; the research has been covered by heise online and t3n.

Timeline

What happened before

  1. Release

    GPT-6.1 Terra

    1.05M context · $1 / $5 per 1M tokens

    openai.com (source, opens in a new tab)
  2. Release

    GPT-6.1 Sol

    1.05M context · $2 / $10 per 1M tokens

    developers.openai.com (source, opens in a new tab)
  3. Release

    GPT-6 Sol & Luna

    1.05M context · $2 / $10 per 1M tokens

    Two GPT-6 reasoning models. Price shown is GPT-6 Sol (≤272K prompt); GPT-6 Luna costs $0.10 / $0.50.

    developers.openai.com (source, opens in a new tab)
  4. Release

    GPT-6 Astra

    1.05M context · $10 / $50 per 1M tokens

    OpenAI's most capable model for reasoning, coding, computer use and research.

    openai.com (source, opens in a new tab)
  5. Release

    GPT-5.6

    1.05M context · $4 / $20 per 1M tokens

    GPT-5.6 family: Sol (frontier), Terra (balanced) and Luna (high-volume).

    developers.openai.com (source, opens in a new tab)
Full ChatGPT timeline ›

Editor's picks

  1. GAO Report: ChatGPT, Claude, Gemini and Grok Produced Viable Attack Plans After Safeguards Were Bypassed
  2. ResolveAI SRE-1: A 27B Model Trained to Find the Root Cause of Production Incidents
  3. Reson8 Rumble-2-Flash: Open-Weight 0.5B Speech Recognition Model Covers 40+ Languages
  4. Pika Enact Lets Creators Direct AI Video Actors and Cameras in Real Time
  5. Google Stitch Loop: An Always-On Product Agent That Fixes Security, Speed and Accessibility via Pull Requests