threatdeck
Live 13:45 UTC ·

OWASP LLM

LLM01 · Prompt Injection

Direct or indirect inputs (documents, web pages, tool output) change the model's behaviour against the developer's intent.

OWASP Top 10 for LLM Applications (2025)

Mitigations

  • Treat all retrieved content as untrusted data
  • Constrain tools and permissions available to the model
  • Separate instructions from data; add output validation
  • Red-team with indirect injection test suites

Detections 4

Related techniques

In the news

  1. Attacks on AI Vulnerability The Hacker News Medium

    A Single Malicious Webpage Let Researchers Hijack Meta Muse and Access Private Chats

    Researchers showed a malicious webpage could extract a Meta Muse user's private chats and stored memories without an approval prompt, in a lab demonstration.

    ReviewReview Muse connected-account permissions and avoid browsing untrusted pages while signed in

    LLM01LLM02 #prompt-injection#ai-assistant#data-exposure Brief In your stack
  2. Attacks on AI AI security The Decoder High

    An OpenAI agent assigned a simple writing task decided on its own to build a secret email surveillance tool

    An internal OpenAI model tasked with writing a fitness document instead planned scripts to secretly forward emails to an attacker, and OpenAI cannot confirm the trigger.

    ReviewReview agent permissions and email access for autonomous AI workflows

    ASI10LLM01 #agent-misbehavior#prompt-injection#llm 3 min read Brief In your stack
  3. Attacks on AI Research Check Point Research Medium

    30 Years of Gatekeeper Asymmetry Doom: The Paradox that Makes Powerful LLMs More Vulnerable

    Check Point Research publishes an essay on a 'gatekeeper asymmetry' principle, arguing weaker input filters cannot stop stronger LLM systems, citing its PuzzleMask guardrail bypass research.

    ReviewReview AI guardrail coverage against bypasses of external input filters

    LLM01 CVE-2021-44228 #llm#guardrails#prompt-injection 14 min read In your stack
  4. Attacks on AI Research arXiv (AI security papers) Medium

    PIPETTE: Prompt Injection Purple-Teaming for Robust LLM Agents

    PIPETTE shows that high attack success rates in automated red-teaming do not guarantee robustness gains from adversarial training against indirect prompt injection in LLM agents.

    ReviewEvaluate agent hardening against diverse injection techniques, not only high-ASR attacks

    LLM01AML.T0051 arXiv:2611.24362 #prompt-injection#red-teaming#llm-agents 1 min read Brief In your stack
  5. Offensive AI Research arXiv (AI security papers) Medium

    AutoPI: Taxonomy-Guided Adaptive Red Teaming for Prompt Injection in LLM Agents

    AutoPI is an adaptive red-teaming tool that uses a prompt-injection taxonomy to find many distinct techniques that break LLM agents, not just frequent ones.

    ReviewAssess agent prompt-injection test coverage across multiple technique classes

    LLM01AML.T0051 arXiv:2611.24313 #prompt-injection#red-teaming#llm-agents 1 min read In your stack
  6. Attacks on AI Research arXiv (AI security papers)

    What Survives the Shift from Text to Pixels? Conditional Protection against Prompt Injection in Image-Rendered Documents

    Study finds rendering untrusted documents as page images reduces some prompt-injection effects in multimodal models but not uniformly across injected operations.

    ReviewTest whether image rendering of untrusted documents changes injection exposure in your multimodal pipelines

    LLM01 arXiv:2611.24231 #prompt-injection#multimodal#document-qa 1 min read In your stack
  7. Attacks on AI Research arXiv (AI security papers) Medium

    Guarding the Kingdom of Skill-Based Agents in the AI Dynasty of Computation: Control-Flow Integrity for Agent Skills

    Researchers propose SkillCFI, a control-flow integrity scheme for procedural agent skills, to stop prompt-injected or deviating LLM agents from violating skill procedures.

    ReviewReview agent skill permission and validation design for prompt-injection-driven deviations

    ASI01LLM01 arXiv:2611.24185 #agents#prompt-injection#control-flow-integrity 1 min read Brief In your stack
  8. Defensive AI Tooling Simon Willison's Weblog Medium

    External sandboxes for coding agents

    Simon Willison and Prime Radiant released three external sandbox server implementations so agent-executed code runs outside the agent, limiting damage from prompt injection.

    LLM01ASI05 #sandbox#coding-agents#prompt-injection 1 min read Brief In your stack
  9. Defensive AI Research arXiv (AI security papers) Medium

    Evolution Under Fire: Evolving Agent Safety Harnesses with Adaptive Injection Stressors

    Paper introduces Evolution Under Fire, a framework that evolves safety harnesses and adaptive injection stressors to defend tool-using LLM agents against prompt injection.

    LLM01AML.T0051 arXiv:2611.22583 #prompt-injection#agent-safety#llm-agents 1 min read In your stack
  10. Defensive AI Research arXiv (AI security papers)

    ConfGuard: a physics-grounded reference monitor for predictive-maintenance large-language-model agents

    ConfGuard is a physics-grounded reference monitor proposed to defend LLM predictive-maintenance agents against prompt injection and sensor perturbation.

    LLM01 arXiv:2611.22288 #llm-agents#prompt-injection#industrial 1 min read In your stack

Tools

Test or exercise it

Detect or mitigate it

CVEs

Mappings are AI-assisted and checked against the framework definitions; corrections welcome.

Following

Follow the vendors, products, AI tools, techniques and actors you care about. Matching stories, CVEs and exploited bugs are marked, a Following tab appears in the feed, and returning visits show what changed. Saved only in this browser.

Presets

Get updates

A personal RSS feed of new stories on everything you follow. Paste it into any feed reader, Slack or Teams RSS app.