threatdeck
Live 14:45 UTC ·

New Technique Medium TD-2026-0035 For AI Eng, AppSec, Red Team AI-assisted

BrainwashedLLM: RL-tuned reasoning traces transfer zero-shot to jailbreak large reasoning models

The arXiv paper BrainwashedLLM uses GRPO reinforcement learning to fine-tune a small white-box model to generate adversarial reasoning traces. These traces, injected as input prefixes, steer larger black-box large reasoning models (LRMs) to continue the adversarial reasoning and produce harmful outputs. The authors report ASR@5 between 0.74 and 0.98 across four LRMs, without querying the target during attack construction.

Why it matters

Organizations deploying LRMs with exposed or user-supplied chain-of-thought context may face jailbreaks that need no access to the target model. Attackers could reuse transferable reasoning prefixes against different hosted models.

Do this

  1. Treat user-supplied or retrieved reasoning text as untrusted input and apply input filtering before it reaches an LRM.
  2. Red-team deployed LRMs with reasoning-prefix injection scenarios and measure refusal rates against this attack class.
  3. Restrict or avoid exposing raw chain-of-thought output to end users, as the paper suggests reasoning buffers should be isolated.
  4. Monitor for unusually long or structured reasoning-style prefixes in prompts that precede harmful requests.

Signals

  • NoCISA KEV
  • 23/100Priority
  • 60%Confidence

Evidence

“When traces are injected as input prefixes, they steer larger black-box LRMs to continue the adversarial reasoning and produce harmful outputs”

arXiv (AI security papers)

“BrainwashedLLM achieves ASR@5 between 0.74 and 0.98 across targets, within 16 points of query-based baselines, without querying the target during attack construction.”

arXiv (AI security papers)

Sources

Affected / related

BrainwashedLLM, Chain-of-Thought jailbreak via reasoning-trace prefix injection, Group Relative Policy Optimization (GRPO)

Published 2026-11-03 11:38 UTC · updated 2026-11-08 17:52 UTC · AI-assisted summary, checked against quoted sources · How we score

Following

Follow the vendors, products, AI tools, techniques and actors you care about. Matching stories, CVEs and exploited bugs are marked, a Following tab appears in the feed, and returning visits show what changed. Saved only in this browser.

Presets

Get updates

A personal RSS feed of new stories on everything you follow. Paste it into any feed reader, Slack or Teams RSS app.