arXiv:2604.01151cs.AIcs.LG2026-04被引 2

通过分析多智能体内部表示,检测其隐蔽合谋行为。

Detecting Multi-Agent Collusion Through Multi-Agent Interpretability

  • 用五种探针技术聚合单智能体欺骗信号,实现群体级合谋检测。
  • 在迁移场景下,最高达0.93 AUROC,在密写扑克任务中达1.00 AUROC。
  • 不同合谋类型需不同检测方法,适合研究多智能体安全与可解释性者。

随着大语言模型智能体在多智能体系统中的广泛应用,其潜在的隐蔽协作风险可能规避常规人工监管。尽管对模型激活值的线性探针在单智能体情境中已展现检测欺骗的潜力,但合谋本质上是多智能体现象,利用内部表征检测智能体间合谋仍属空白。本文提出NARCBench基准,用于评估环境分布偏移下的合谋检测性能,并设计五种探针技术,通过聚合各智能体的欺骗得分实现群体层面分类。实验覆盖四个开源模型(Qwen3-32B、Llama-3.1-70B、DeepSeek-R1 32B、GPT-OSS-20B)及六种探针架构。将该问题建模为分布式异常检测,识别出三类合谋特征,对应不同异常类型与检测范式。所有模型在分布内均达1.00 AUROC;在最强模型Llama-3.1-70B上,五种探针在零样本迁移至结构不同的多智能体场景时,AUROC为0.73至0.93,而在密写扑克计牌任务上达0.99至1.00,检测性能随模型能力提升。结果表明无单一探针在所有合谋类型中占优,符合框架预测:不同异常类型需不同检测范式。本工作推进了多智能体可解释性研究,将白盒分析从单模型扩展至多智能体上下文,强调跨智能体信号聚合的重要性。结果表明模型内部信息可作为文本监控的互补信号,有效识别多智能体合谋。代码与数据见https://github.com/aaronrose227/narcbench。

原文摘要 · Abstract (English)

As LLM agents are increasingly deployed in multi-agent systems, they introduce risks of covert coordination that may evade standard forms of human oversight. While linear probes on model activations have shown promise for detecting deception in single-agent settings, collusion is inherently a multi-agent phenomenon, and the use of internal representations for detecting collusion between agents remains unexplored. We introduce NARCBench, a benchmark for evaluating collusion detection under environment distribution shift, and propose five probing techniques that aggregate per-agent deception scores to classify scenarios at the group level, evaluated across four open-weight models (Qwen3-32B, Llama-3.1-70B, DeepSeek-R1 32B, GPT-OSS-20B) and six probe architectures. We frame this as a distributed anomaly detection problem, identifying three collusion signatures that map onto distinct anomaly types and detection paradigms. Every model reaches 1.00 AUROC in-distribution; on our strongest model (Llama-3.1-70B), our five probing techniques achieve 0.73 to 0.93 AUROC when transferred zero-shot to structurally different multi-agent scenarios and 0.99 to 1.00 on a steganographic blackjack card-counting task, with detection performance scaling with model capability. We find that no single probing technique dominates across all collusion types, consistent with the framework's prediction that different anomaly types require different detection paradigms. This work takes a step toward multi-agent interpretability: extending white-box inspection from single models to multi-agent contexts, where detection requires aggregating signals across agents. These results suggest that model internals provide a complementary signal to text-level monitoring for detecting multi-agent collusion. Code and data available at https://github.com/aaronrose227/narcbench.

多智能体合谋检测可解释性异常检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。