arXiv:2607.24893cs.CRcs.AI2026-07

发现并拦截分布式后门攻击,提前5步预警成功率超99%。

Early Detection of Distributed Backdoors in Multi-Agent LLM Systems: A Characterization Study

论文配图:Early Detection of Distributed Backdoors in Multi-Agent LLM Systems: A Characterization Study
图 1 · 摘自论文原文
  • 通过检测多智能体系统中分散的恶意片段,实现早期攻击识别。
  • 攻击注入后5步内可预警99.3%的成功攻击,误报率10.3%。
  • 方法对隐蔽结构敏感,适合安全验证与模型鲁棒性研究者。

多智能体大语言模型系统可能遭受分布式后门攻击:恶意载荷不完整存在于任一智能体中,而是将加密片段散布于多个智能体的观察结果中,运行结束后由外部步骤重组执行。逐步安全检查因孤立判断行为而难以察觉完整攻击。本文在分层多智能体系统上构建实例,对比五种语言模型与两个任务域下的正常与受攻击运行,记录各片段注入时间及载荷组装执行时刻。检测需在载荷组装前完成。攻击注入前,异常与正常运行无法区分;一旦注入开始,前缀检测器可在平均5步剩余时成功预警99.3%的攻击,且正常运行误报率为10.3%。由于组装发生在运行结束后,此类警报足以及时中止多数成功攻击。进一步分析发现,当前有效检测部分依赖可移除的表面特征(如密文长度、熵值)。移除这些特征后,通用零样本与行为训练检测器几乎失效;仅微调模型能部分恢复性能,但跨领域迁移能力下降。

原文摘要 · Abstract (English)

Multi-agent LLM systems can be attacked by a payload that no single agent ever holds in full: a poisoned tool hides encrypted fragments in its observations, spreads them across several agents, and an external step reassembles and executes them after the run. Per-step safety checks that judge each action in isolation may fail to recognize the complete distributed payload. We investigate how early such an attack can be detected while the run is still unfolding, and how robustly it can be caught once its most obvious cues are stripped away. We build a working instance on a hierarchical multi-agent system, run it under benign and attacked conditions across five language models and two task domains, and record when each fragment is injected and when the payload is assembled and executed. Detection is a race against assembly. Before the first fragment is injected, attacked and benign runs are indistinguishable; once injection begins, a prefix detector flags $99.3\%$ of successful attacks with a median of five steps remaining and a $10.3\%$ safe-run false-positive rate. Because assembly occurs only after the run, these alarms arrive in time to abort nearly every successful attack. We then measure how much of that warning rests on removable surface cues of the attack rather than on its distributed structure. Generic zero-shot and behavior-trained detectors provide almost no warning at all; the detectors that do work lean in part on removable surface cues, chiefly the ciphertext's length and entropy, and once the entropy cue is removed from the payload and the length features from the detector, detection arrives later and transfers poorly across domains, though a fine-tuned model recovers some of the loss.

后门检测多智能体安全验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。