threatdeck
Live 14:45 UTC ·

New Technique Medium TD-2026-0084 For AI Eng, AppSec, Red Team, CISO AI-assisted

Agentic attacker reliably injects instructions into tool output across frontier models

The paper presents a synthetic prompt injection evaluation that uses random non-malicious actions as adversarial goals. It reports that an agentic attacker with increased capabilities can reliably get models to follow instructions found in tool output. The authors say this holds even for models previously considered robust on public benchmarks such as GraySwan Arena.

Why it matters

Organizations deploying tool-using AI agents may assume benchmark robustness implies protection against injected instructions. Attackers who automate injection attempts could make agents take unintended actions via untrusted tool output.

Do this

  1. Treat all tool and retrieval output as untrusted data and enforce instruction hierarchy in agent design.
  2. Restrict agent tool permissions so injected instructions cannot trigger high-impact actions without approval.
  3. Add human confirmation for sensitive tool calls initiated after reading external content.
  4. Run automated, recurring prompt injection red-teaming against agent deployments rather than relying on static benchmarks.
  5. Log and review agent tool calls that follow content retrieved from external sources.

Signals

  • NoCISA KEV
  • 23/100Priority
  • 60%Confidence

Evidence

“We show that an agentic attacker of increased capabilities can reliably trick model to follow instructions in tool output in our evaluation”

arXiv (AI security papers)

Sources

Affected / related

Prompt injection via tool output, Agentic adaptive prompt injection attacks

Published 2026-11-09 04:34 UTC · updated 2026-11-12 18:05 UTC · AI-assisted summary, checked against quoted sources · How we score

Following

Follow the vendors, products, AI tools, techniques and actors you care about. Matching stories, CVEs and exploited bugs are marked, a Following tab appears in the feed, and returning visits show what changed. Saved only in this browser.

Presets

Get updates

A personal RSS feed of new stories on everything you follow. Paste it into any feed reader, Slack or Teams RSS app.