Google DeepMind published research on November 9, 2026, demonstrating that automated swarms of LLM agents can systematically break prompt injection defenses on frontier models. The study found that six of seven tested models resisted 10% or fewer attack scenarios when the attacker used its full query budget.
Quick Take
- What: Automated agent swarms found working prompt injections against models rated as robust on public benchmarks
- Who is affected: Seven models tested: Gemini 3.6 Flash (1% resistance), Gemini 3.7 Flash (6%), Gemini 3.8 Flash (10%), Gemini 4 Argon (66%), Kimi K3 (1%), GLM-5.3 (1%), and DeepSeek-V4.1-Flash (1%)
- Research team: Alexey Kurakin, Vishal Karande, Alex Bie, Chongyang Shi, Shuang Song at Google DeepMind
- Key finding: Only Gemini 4 Argon maintained 66% resistance, all others fell to 10% or below
- What to do: Do not rely on model hardening alone, implement defense in depth
In plain English
Google researchers built an automated system that uses multiple AI agents working together to find ways to trick other AI models into ignoring their instructions. They tested seven different AI models, and six of them failed to resist these attacks more than 90% of the time. Only one model, Gemini 4 Argon, held up well. The researchers say AI companies need multiple layers of protection, not just harder-to-trick models.
What you should do: If you are an ordinary user of AI chatbots, you do not need to do anything, but this shows the AI systems you use may be vulnerable to sophisticated attacks.
What happened
Google DeepMind published “Scaling Adaptive Prompt Injection Attacks with Agent Swarms” on arXiv on November 9, 2026. The research team, with Alexey Kurakin as corresponding author, built an automated attacker that runs many LLM agents in parallel to search for prompt injections. The system then measured how seven defender models held up against these attacks.
The attacker treats prompt injection as a search problem, spending a query budget probing the defender and adapting each attempt based on what the previous one returned. Attack goals were random non-malicious actions rather than harmful ones, which separates how well a model holds its instruction hierarchy from how well it recognizes danger.
The paper measures Attack Resistance Rate, the share of scenarios where the attack failed. A lower number means a stronger attack. At the full query budget of 150 defender queries (320 calls in total), six of the seven models resisted 10% or fewer of the attack scenarios.
Who is affected
Seven models served as defenders with thinking on and chain of thought hidden:
- Gemini 3.6 Flash: 1% attack resistance
- Gemini 3.7 Flash: 6% attack resistance
- Gemini 3.8 Flash: 10% attack resistance
- Gemini 4 Argon: 66% attack resistance (strongest defender)
- Kimi K3: 1% attack resistance
- GLM-5.3: 1% attack resistance
- DeepSeek-V4.1-Flash: 1% attack resistance
Gemini 4 Argon was both the strongest defender and the strongest attacker in the study. The attacker broke 6 of 80 AgentDojo scenarios in 25 queries, compared to 2 for the prior Prompt Siren technique.
What it means
The research demonstrates that models scoring as robust on public benchmarks can still be vulnerable to adaptive, automated attacks. The authors argue that model hardening should be part of a full stack with defense in depth, not relied upon alone.
The authors also state that frontier defenses may need proactive, automated red-teaming to stay resilient against more capable adversaries. The study shows that as attackers gain access to more sophisticated tools, including agent swarms, the gap between benchmark performance and real-world resilience may widen.



