通过可靠性评估筛选信息三元组,提升多跳问答中抗误导信息能力。
ReliableRAG: Combating Misinformation in Retrieval-Augmented Generation via Reliability-Guided Reasoning Chains

- 将文档信息拆解为三元组,结合语义相关性与可信度量化可靠性。
- 在三个数据集上显著提升准确率,错误答案减少超过40%。
- 适合需要高可靠性的新闻、社交内容问答场景。
检索增强生成(RAG)通过将外部信息融入大语言模型,在问答任务中表现出强大能力。然而,新闻与社交媒体中的虚假、不实及误导性信息对真实世界RAG系统构成严峻挑战,尤其在多跳问答中,即使一个误导性信息片段也可能导致复杂推理链出错。现有方法主要依赖隐式对齐或显式约束,但其对细粒度信息可靠性的评估能力有限,难以识别语义相关却事实错误的误导信息,导致错误回答。为此,我们提出ReliableRAG,据我们所知是首个基于可靠性的框架,通过细粒度评估单个三元组来缓解多跳问答中的误导信息。ReliableRAG首先从源文档中提取信息段并表示为结构化三元组,再结合查询-三元组语义相关性与三元组可信度量化其可靠性,仅保留前-K个可靠且非冗余三元组。基于这些优化后的三元组,ReliableRAG自回归构建稳健的推理链,整合可信证据并过滤误导信息,生成忠实于可靠信息的准确答案。在三个多跳问答数据集上的实验表明,ReliableRAG优于现有方法,显著提升了RAG系统的事实可靠性与鲁棒性,尤其在注入误导信息的条件下表现突出。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) has emerged as a powerful architecture for Question Answering (QA) by integrating external information into Large Language Models (LLMs). However, false, inaccurate, and misleading information in news and social media poses a serious challenge to real-world RAG systems, especially in multi-hop QA, where complex multi-step reasoning can be misled by even a single deceptive misinformation segment in the retrieved documents. Existing approaches mainly rely on implicit alignment or explicit regulation, but their limited ability to assess fine-grained information reliability makes them vulnerable to deceptive misinformation that is semantically relevant to the question yet factually incorrect, leading to erroneous answers. To address this limitation, we propose ReliableRAG, which, to the best of our knowledge, is the first reliability-driven framework that mitigates deceptive misinformation in multi-hop QA through fine-grained evaluation of individual triples. ReliableRAG first extracts information segments from source documents and represents them as structured triples. It then quantifies triple reliability by combining query-triple semantic relevance with triple credibility, retaining only the top-$K$ reliable and non-redundant triples. Based on these refined triples, ReliableRAG autoregressively constructs robust reasoning chains to consolidate trustworthy evidence and filter deceptive misinformation, producing accurate answers faithful to reliable information. Experiments on three multi-hop QA datasets show that ReliableRAG outperforms existing methods, substantially improving the factual reliability and robustness of RAG systems under deceptive misinformation injection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。