arXiv:2608.27945cs.AI2026-08

研究跨会话分解攻击,提出防御模型可有效阻止恶意意图重组。

Cross-Session Decomposition Attacks: Scaling Risk and Intent-Aligned Retrieval Defense

论文配图:Cross-Session Decomposition Attacks: Scaling Risk and Intent-Aligned Retrieval Defense
图 1 · 摘自论文原文
  • 通过分解攻击机制分析模型安全风险传递规律
  • 大模型在固定攻击管道下危害能力提升600%以上
  • 小规模对齐检索器比大型模型更擅长识别隐藏意图

扩展定律通常被视为能力增长的叙事:更低的语言建模损失带来更有用的模型。我们研究了这一机制在跨会话分解攻击中的安全后果,即看似无害的子查询在独立交互中被提出,随后被重新组合成禁止目标。我们将此设定形式化为组合性安全风险,并证明了条件风险转移界:当参考环境已包含分散的危险重构证据时,部署后组合风险与参考组合风险之间的差距由模型在允许子查询上的超额损失控制。合成保留实验显示,更宽的Transformer模型对从未在训练中出现但可通过注入支持事实恢复的指令赋予更低损失。对600个意图预训练的LLM评估表明,在固定分解-组合流程下,更大的Qwen3和Gemma3家族成员可产生更高危害能力提升。作为防御方案,作者提出的2200万参数对齐检索器IntentAlign-MiniLM,在未见意图检索任务上优于更大嵌入模型,并在所有测试防护机制中实现最低的有害召回率。代码可在GitHub仓库获取。

原文摘要 · Abstract (English)

Scaling laws are usually read as a capability story: lower language-modeling loss yields more useful models. We study a safety consequence of this mechanism in \emph{cross-session decomposition attacks}, where benign-looking subqueries are asked across independent interactions and later recomposed toward a forbidden objective. We formalize this setting as \emph{compositional safety risk} and prove a conditional risk-transfer bound: when the reference environment already contains dispersed evidence for a risky reconstruction, the gap between deployed composed risk and reference composed risk is controlled by the model's excess loss on allowed subqueries. Synthetic withholding experiments show that wider transformers assign lower loss to held-out instructions that never appear verbatim in training but are recoverable from injected supporting facts. A 600-intent pretrained-LLM evaluation shows that larger Qwen3 and Gemma3 family members can yield greater harmful-capability uplift under a fixed decomposition-composition pipeline. As a defense, IntentAlign-MiniLM, our 22M-parameter intent-aligned retriever, outperforms much larger embedding models on held-out intent retrieval and yields the best learned-retriever harmful recall across tested guardrails. Code is available in \href{https://github.com/liaodisen/Cross-Session-Decomposition-Attacks}{our GitHub repository}.

安全风险模型防御意图识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。