arXiv:2603.24579cs.CL2026-03被引 4

用多智能体协作检测大模型幻觉,有效降低错误率。

MARCH: Multi-Agent Reinforced Self-Check for LLM Hallucination

  • 设计三个智能体:生成、拆解、独立验证,打破自我确认偏见。
  • 80亿参数模型用MARCH后表现媲美闭源大模型,幻觉率显著下降。
  • 适合需要高可靠性的信息检索生成系统,如医疗、法律场景。

幻觉仍是大语言模型(LLMs)在真实应用中的关键瓶颈,尤其在检索增强生成(RAG)系统中。现有方法使用大模型作为裁判验证输出与检索证据的一致性,但存在固有确认偏差,裁判会无意中重复生成的错误。为此,我们提出多智能体强化自检框架MARCH,通过刻意制造信息不对称来实现严格的事实对齐。MARCH协调三个专用智能体:求解器生成初始RAG响应,提议者将其分解为可验证的原子命题,验证者则在隔离状态下独立比对这些命题与检索证据。这种精心设计的信息不对称机制打破了自我确认的循环。通过多智能体强化学习(MARL)训练该流程,使智能体协同进化并优化事实一致性。在多个幻觉检测基准上的实验表明,MARCH显著降低了幻觉率。值得注意的是,一个80亿参数的LLM在引入MARCH后,性能可媲美强大的闭源模型。MARCH为大模型的事实自提升提供了可扩展路径。代码已开源:https://github.com/Qwen-Applications/MARCH。

原文摘要 · Abstract (English)

Hallucination remains a critical bottleneck for large language models (LLMs), undermining their reliability in real-world applications, especially in Retrieval-Augmented Generation (RAG) systems. While existing hallucination detection methods employ LLM-as-a-judge to verify LLM outputs against retrieved evidence, they suffer from inherent confirmation bias, where the verifier inadvertently reproduces the errors of the original generation. To address this, we introduce Multi-Agent Reinforced Self-Check for Hallucination (MARCH), a framework that enforces rigorous factual alignment by leveraging deliberate information asymmetry. MARCH orchestrates a collaborative pipeline of three specialized agents: a Solver, a Proposer, and a Checker. The Solver generates an initial RAG response, which the Proposer decomposes into claim-level verifiable atomic propositions. Crucially, the Checker validates these propositions against retrieved evidence in isolation, deprived of the Solver's original output. This well-crafted information asymmetry scheme breaks the cycle of self-confirmation bias. By training this pipeline with multi-agent reinforcement learning (MARL), we enable the agents to co-evolve and optimize factual adherence. Extensive experiments across hallucination benchmarks demonstrate that MARCH substantially reduces hallucination rates. Notably, an 8B-parameter LLM equipped with MARCH achieves performance competitive with powerful closed-source models. MARCH paves a scalable path for factual self-improvement of LLMs through co-evolution. The code is at https://github.com/Qwen-Applications/MARCH.

大模型幻觉多智能体RAG自检

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。