通过跨账户状态监控,提前30%发现分布式语言模型攻击
Stateful Online Monitoring Catches Distributed Agent Attacks

- 用实时聚类整合多账号可疑信号,识别分散式攻击
- 在大规模模拟中比传统监控早30%发现攻击,误报率极低
- 适合防御复杂攻击和通用越狱,对99%用户无延迟
语言模型可发现数千个严重软件漏洞,而攻击者正越来越多地滥用智能体进行网络攻击。为逃避检测,攻击者常将有害任务拆分至多个用户账户,使每个单独会话看似正常。现有安全监控仅评估单个智能体上下文,对跨账户聚合才显现的滥用行为完全无感。我们首次构建了分布式智能体攻击,通过多智能体协同完成高难度安全任务,同时将恶意目标隐藏于各子智能体的有限上下文中,使标准监控捕获率仅为以往攻击的五分之一。为此,我们提出一种在线状态化监控系统,利用实时聚类收集多个智能体会话中的弱可疑信号,并仅在必要时调用语言模型跨账户识别滥用。在大规模模拟数据中心流量中,该系统在性能上全面优于传统监控:提前30%捕获分布式攻击,且在99%用户流量下几乎无额外延迟。随着良性背景流量增大,优势略有缩小。经过详尽红队测试后,我们进一步优化防御,意外发现其也能有效检测标准越狱攻击,因自适应攻击者常在不同账户复用攻击模式。结果表明,未来安全监控应从孤立会话转向群体推理。
原文摘要 · Abstract (English)
Language models can find thousands of severe software vulnerabilities, and agents are increasingly being misused for cyberattacks. To avoid detection, attackers frequently distribute their misuse, splitting a harmful task across many user accounts so each individual transcript looks benign. Because safety monitors score only one agent context at a time, they are structurally blind to misuse that is only visible in aggregate, across many accounts. We show this gap is real by building, to our knowledge, the first distributed agent attack, a multi-agent scaffold that completes hard cybersecurity tasks while hiding the harmful objective across subagents with limited contexts, evading a standard monitor that catches it only a fifth as often as prior agent attacks. Towards a defense, we develop an online stateful monitor that uses real-time clustering to collect weak suspiciousness signals across many agent transcripts, and escalates only rarely to a language model that flags misuse across user accounts. In evaluations with large-scale simulated datacenter traffic, our monitor Pareto dominates standard monitors, catching distributed attacks 30% earlier and flagging cyber misuse before it reaches the most harmful stages. Crucially, this comes at negligible additional latency for ~99% of user traffic. This detection advantage persists but narrows as the benign background traffic grows very large. After an extensive red-teaming exercise, we improve the defense and surprisingly also find that it catches standard jailbreaks, since adaptive attackers reuse attack variants across accounts. Our results point toward a new class of safety monitors which reason over groups of users rather than isolated transcripts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。