threatdeck
Live 13:45 UTC ·

MITRE ATLAS · Defense Evasion, Privilege Escalation

AML.T0054 · LLM Jailbreak

Adversaries may induce a large language model (LLM) to ignore, circumvent, or override its safety/alignment behaviors and/or guardrails to elicit outputs the model is intended to withhold. Once jailbroken, the LLM may be used in unintended ways by the adversary. Jailbreaks may be achieved via adversarial prompting, or by modifying model weights or safety mechanisms.

MITRE ATLAS

Mitigations

  • Validate AI Model
  • Generative AI Guardrails
  • Generative AI Guidelines
  • Generative AI Model Alignment
  • AI Red Team

Detections 3

Related techniques

In the news

  1. Attacks on AI Research arXiv (AI security papers) Medium

    Dressed in Authority: Practical Black-Box Jailbreaking of MLLMs via Visual Trust Bias

    Researchers propose VTBA, a black-box jailbreak for multimodal LLMs that exploits their trust bias toward authoritative visual features.

    AML.T0054 arXiv:2611.22292 #jailbreak#mllm#multimodal 1 min read Brief In your stack
  2. Attacks on AI Research arXiv (AI security papers) Medium

    Is 4-Bit Quantization More Than Noise to a Chat Model's Safety Behaviour? Attributing Behavioural Shifts with Matched Perturbations

    Study finds 4-bit quantization shifts refusal behaviour in Qwen2.5-3B and Llama-3.2-3B chat models, with one model complying with jailbreaks more often and the other less.

    AML.T0054 arXiv:2611.22186 #llm#jailbreak#quantization 1 min read In your stack

Tools

Test or exercise it

Detect or mitigate it

Mappings are AI-assisted and checked against the framework definitions; corrections welcome.

Following

Follow the vendors, products, AI tools, techniques and actors you care about. Matching stories, CVEs and exploited bugs are marked, a Following tab appears in the feed, and returning visits show what changed. Saved only in this browser.

Presets

Get updates

A personal RSS feed of new stories on everything you follow. Paste it into any feed reader, Slack or Teams RSS app.