arXiv:2608.05302cs.IR2026-08

用多源证据共识机制纠正AI新闻摘要幻觉

Cross-platform epistemic verification for improving factual reliability in AI-generated news summarization

  • 融合原文、维基和网络检索的多源证据验证
  • 通过多模型共识评分识别不实陈述,迭代修正
  • 适用于金融等敏感领域,提升事实可靠性

本研究提出多源证据共识验证(MECV)框架,用于后处理AI生成新闻摘要中的幻觉问题。该框架不依赖单一检索渠道,而是整合来源文档、维基百科及开放网络检索的异构证据。引入多大模型评审机制,通过矛盾感知的共识评分评估事实可靠性,对可能缺乏支持的陈述进行迭代最小编辑修正。在SummEdits基准上使用GPT-4o-mini与DeepSeek-Chat作为评审模型,Qwen-Plus作为协调器进行评估。实验表明,MECV在保持原始摘要语义结构的同时显著提升事实一致性。结果进一步表明,异构证据源间的共识可作为识别AI生成摘要中事实不确定性的有效信号,尤其在金融新闻聚合等信息敏感领域。本研究为可信AI与自动化新闻提供了多源验证框架,验证了基于共识的验证对提升事实可靠性的价值。

原文摘要 · Abstract (English)

This study proposes Multi-source Evidence Consen- sus Verification (MECV), a post-hoc hallucination cor- rection framework for AI-generated news summariza- tion. Instead of depending on a single retrieval channel, MECV aggregates evidence from multiple heterogeneous sources, including the source document, Wikipedia, and open-web retrieval. The framework further incorporates a multi-LLM jury mechanism that estimates factual reliabil- ity through contradiction-aware consensus scoring across verifier models. Claims identified as potentially unsup- ported are revised through iterative minimal-edit refine- ment. The proposed framework is evaluated on the SummEd- its benchmark using GPT-4o-mini and DeepSeek-Chat as the verifier jury, with Qwen-Plus as the orchestra- tor. Experimental results show that MECV improves fac- tual consistency while preserving the semantic structure of the original summaries. The findings further suggest that agreement across heterogeneous evidence sources can serve as a useful signal for identifying factual uncertainty in AI-generated summaries, including in information- sensitive domains such as financial news aggregation. This study contributes to research on trustworthy AI and automated journalism by introducing a multi-source verification framework for hallucination correction and demonstrating the value of consensus-based verification for improving factual reliability in AI-generated news summarization.

事实验证新闻摘要幻觉纠正多模型共识

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。