arXiv:2510.15965cs.LGcs.AI2025-10NeurIPS被引 3

一个恶意嵌入就能让大模型陷入无限思考死循环。

One Token Embedding Is Enough to Deadlock Your Large Reasoning Model

  • 用对抗性嵌入诱导模型反复使用'等一下'类过渡词
  • 在4个主流模型上实现100%成功率,逼其达到最大输出长度
  • 攻击隐蔽且能绕过现有防过思考机制,适合安全研究者关注

现代大型推理模型(LRMs)通过思维链(CoT)实现多步问题求解,但其迭代推理机制引入了新的漏洞。本文提出死锁攻击(Deadlock Attack),一种通过训练恶意对抗嵌入来劫持生成控制流的资源耗尽方法,诱导模型陷入永无止境的推理循环。关键挑战在于连续到离散的投影鸿沟:直接将对抗嵌入映射为词元序列会使其失效。为此,我们设计后门植入策略,通过特定触发词元可靠激活攻击。该方法在四个先进模型(Phi-RM、Nemotron-Nano、R1-Qwen、R1-Llama)和三个数学推理基准上均实现100%攻击成功率,迫使模型生成至最大词元限制。攻击在良性输入上造成可忽略的性能损失,且对现有缓解过思考的方法具有鲁棒性。研究揭示了从推理效率角度出发的大型推理模型中一个关键且未被充分探索的安全隐患。

原文摘要 · Abstract (English)

Modern large reasoning models (LRMs) exhibit impressive multi-step problem-solving via chain-of-thought (CoT) reasoning. However, this iterative thinking mechanism introduces a new vulnerability surface. We present the Deadlock Attack, a resource exhaustion method that hijacks an LRM's generative control flow by training a malicious adversarial embedding to induce perpetual reasoning loops. Specifically, the optimized embedding encourages transitional tokens (e.g., "Wait", "But") after reasoning steps, preventing the model from concluding its answer. A key challenge we identify is the continuous-to-discrete projection gap: naïve projections of adversarial embeddings to token sequences nullify the attack. To overcome this, we introduce a backdoor implantation strategy, enabling reliable activation through specific trigger tokens. Our method achieves a 100% attack success rate across four advanced LRMs (Phi-RM, Nemotron-Nano, R1-Qwen, R1-Llama) and three math reasoning benchmarks, forcing models to generate up to their maximum token limits. The attack is also stealthy (in terms of causing negligible utility loss on benign user inputs) and remains robust against existing strategies trying to mitigate the overthinking issue. Our findings expose a critical and underexplored security vulnerability in LRMs from the perspective of reasoning (in)efficiency.

模型安全对抗攻击推理效率死锁攻击

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。