arXiv:2511.11182cs.AIcs.CL2025-11中稿 · AAAI被引 4

用反事实测试揪出幻觉的智能体,提升多模态推理可靠性

Multi-agent Undercover Gaming: Hallucination Removal via Counterfactual Test for Multimodal Reasoning

  • 通过反事实测试识别幻觉智能体,替代依赖理性假设的共识机制
  • 在图像篡改场景下,85%的幻觉智能体被成功检测,验证了方法有效性
  • 适合需要高可信度推理的多模态应用,如医疗影像分析

幻觉仍是大语言模型(LLMs)推理能力的主要障碍。尽管多智能体辩论(MAD)通过促进多个智能体达成共识来提升可靠性,但其依赖所有辩论者均理性且反思的不现实假设,而当智能体自身易产生幻觉时,该假设难以成立。为此,我们提出多智能体潜伏博弈(MUG)协议,受“谁是卧底”等社交推理游戏启发。MUG将MAD重构为通过多模态反事实测试检测“潜伏”智能体(即存在幻觉者)的过程。具体地,我们修改参考图像以引入反事实证据,并观察智能体是否能准确识别这些变化,从而提供判断幻觉的真值标准,实现可靠的群体驱动式多模态推理。MUG在三个关键维度推进MAD:(1) 通过反事实测试实现超越统计共识的事实验证;(2) 通过动态修改证据源实现跨证据推理,而非依赖静态输入;(3) 培养主动推理,使智能体进行探询性讨论,而非被动回答问题。这些创新共同构建了一个更可靠、高效的多模态推理框架。源代码见 https://github.com/YongLD/MUG.git。

原文摘要 · Abstract (English)

Hallucination continues to pose a major obstacle in the reasoning capabilities of large language models (LLMs). Although the Multi-Agent Debate (MAD) paradigm offers a promising solution by promoting consensus among multiple agents to enhance reliability, it relies on the unrealistic assumption that all debaters are rational and reflective, which is a condition that may not hold when agents themselves are prone to hallucinations. To address this gap, we introduce the Multi-agent Undercover Gaming (MUG) protocol, inspired by social deduction games like "Who is Undercover?". MUG reframes MAD as a process of detecting "undercover" agents (those suffering from hallucinations) by employing multimodal counterfactual tests. Specifically, we modify reference images to introduce counterfactual evidence and observe whether agents can accurately identify these changes, providing ground-truth for identifying hallucinating agents and enabling robust, crowd-powered multimodal reasoning. MUG advances MAD protocols along three key dimensions: (1) enabling factual verification beyond statistical consensus through counterfactual testing; (2) introducing cross-evidence reasoning via dynamically modified evidence sources instead of relying on static inputs; and (3) fostering active reasoning, where agents engage in probing discussions rather than passively answering questions. Collectively, these innovations offer a more reliable and effective framework for multimodal reasoning in LLMs. The source code can be accessed at https://github.com/YongLD/MUG.git.

多智能体幻觉检测反事实推理多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。