arXiv:2606.10747cs.AI2026-06

用智能审计员实时监控多智能体对话,提前发现行为偏差。

The Arbiter Agent: Continually Monitoring Multi-Agent Conversations to Detect Emergent Misalignment

  • 设计一个资源受限的审计代理,动态选择检查策略
  • 能提前检测到错误决策,权重偏差最难识别
  • 适合需要安全可控的多智能体协作场景

随着由多个语言模型智能体构成的AI系统日益普及,它们被用于共同讨论、协商并执行任务。尽管单个智能体在独立测试时表现良好,但交互过程中可能产生对齐问题。本文提出Arbiter——一个实时监控多智能体对话的审计代理,能在有限的‘检查预算’下,通过等待、提问、审查内部信息或记录异常行为来判断是否存在偏差。在五种不同对话情境(包括高风险金融建议、评估感知与串谋智能体)中测试了五种能力递增的工具配置和两种骨干模型。结果显示,主动检查工具显著提升检测准确率与速度;权重诱导的对齐偏差最难发现,而指令诱导偏差即使在被动观察下也能可靠识别;日志工具虽提高召回率,但降低精确率。结果表明,持续且预算敏感的监控可有效捕捉对齐问题,审计本身需作为协作过程中的活跃参与者。代码已开源:https://github.com/aisilab/arbiter。

原文摘要 · Abstract (English)

As AI systems built from multiple language-model agents become more common, they are increasingly used to make decisions together: discussing, negotiating, and acting on shared tasks. While individual agents may appear well-aligned when tested on their own, problems can arise from how they interact with one another. We introduce the Arbiter, an agent designed to monitor multi-agent conversations in real time and identify which participants may be behaving in misaligned ways. The Arbiter operates under a limited "inspection budget", meaning it must decide carefully how to use its resources. As it observes a conversation step by step, it can choose to wait, question a participant, examine internal information such as system prompts or reasoning traces, or log concerning behavior. At the end, it produces a report identifying the likely source of misalignment. We evaluate the Arbiter across five conversation conditions, ranging from risky financial advice model organisms to evaluation-aware and colluding agents, we test five tool configurations of increasing capability and two backbone models. We find that the Arbiter reliably detects misaligned agents well before the end of the conversation, with active inspection tools improving both detection accuracy and speed. Weight-induced misalignment proves hardest to detect, while instruction-induced misalignment is identified reliably even under passive observation. The logging tool exhibits a dual effect, improving recall at the cost of precision. These results suggest that continual, budget-aware monitoring can effectively catch misalignment, and that overseeing multi-agent systems may require treating the auditor as an active participant in the process. The code is available at https://github.com/aisilab/arbiter.

多智能体对齐监测审计代理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。