让大模型生成时优先信任可靠信息源,提升回答准确性。
Retrieval-Augmented Generation with Estimation of Source Reliability
- 通过多源交叉验证评估信息源可靠性,动态加权。
- 在混合不可靠源场景下,准确率显著优于基线方法。
- 适合需要高可信度回答的医疗、法律等专业领域。
检索增强生成(RAG)通过从外部数据库检索信息来弥补大语言模型(LLM)内部知识的不足,但标准RAG仅依赖查询与文档的相关性,忽视了不同信息源之间的可靠性差异。为此,本文提出可靠性感知的RAG(RA-RAG),一种新型多源RAG框架。该框架首先通过跨源交叉验证估算各信息源的可靠性,然后从可靠性最高且相关性最强的前κ个源中检索文档,并采用加权多数投票(WMV)聚合信息。该方法在保证可扩展性的同时不牺牲性能。大量实验表明,在异构源可靠性条件下,RA-RAG持续优于现有基线方法,且随着源数量增加仍能高效扩展。此外,我们验证了其对真实世界信息源可靠性的估计能力,展现出良好的实际应用价值。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) is an effective approach to enhance the factual accuracy of large language models (LLMs) by retrieving information from external databases, which are typically composed of diverse sources, to supplement the limited internal knowledge of LLMs. However, the standard RAG often risks retrieving incorrect information, as it relies solely on relevance between a query and a document, overlooking the heterogeneous reliability of these sources. To address this issue, we propose Reliability-Aware RAG (RA-RAG), a new multi-source RAG framework that estimates the reliability of sources and leverages this information to prioritize highly reliable and relevant documents, ensuring more robust and accurate response generation. Specifically, RA-RAG first estimates source reliability by cross-checking information across multiple sources. It then retrieves documents from the top-$κ$ reliable and relevant sources and aggregates their information using weighted majority voting (WMV), where the selective retrieval ensures scalability while not compromising the performance. Comprehensive experiments show that RA-RAG consistently outperforms baselines in scenarios with heterogeneous source reliability while scaling efficiently as the number of sources increases. Furthermore, we demonstrate the ability of RA-RAG to estimate real-world sources' reliability, highlighting its practical applicability. \jy{Our code and data are available at \href{https://github.com/ml-postech/RA-RAG}{RA-RAG}.}
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。