提出新框架Radiant,提升大模型在检索增强生成中对事实信息的准确整合能力。
RADIANT: Retrieval AugmenteD entIty-context AligNmenT -- Introducing RAG-ability and Entity-Context Divergence
- 用改进的直接偏好优化方法,让模型学会融合外部检索信息
- 实测发现多数大模型在检索增强下仍存在事实偏差,RAG-ability普遍较低
- 适用于需要高准确性和上下文一致性的生成场景,如医疗、法律问答
随着大语言模型(LLMs)的发展,检索增强生成(RAG)已成为提升生成内容事实准确性的重要技术。然而,模型常无法忠实整合检索到的信息,导致事实不一致。为此,本文提出实体-上下文偏离度(ECD)作为量化指标,衡量检索信息在输出中的反映程度,并定义了模型在检索增强设置下的事实一致性保持能力为RAG-ability。系统评估显示,多数现有大模型的RAG-ability仍然偏低,存在实体保留与上下文忠实性不足的问题。本文提出Radiant(Retrieval AugmenteD entIty-context AligNmenT)框架,将RAG与对齐机制结合,通过扩展直接偏好优化(DPO)训练模型有效整合外部信息。该方法在噪声网页上下文、知识冲突和幻觉减少等多样检索场景中均显著提升性能,实现更可靠、上下文相关且事实一致的内容生成。
原文摘要 · Abstract (English)
As Large Language Models (LLMs) continue to advance, Retrieval-Augmented Generation (RAG) has emerged as a vital technique to enhance factual accuracy by integrating external knowledge into the generation process. However, LLMs often fail to faithfully integrate retrieved evidence into their generated responses, leading to factual inconsistencies. To quantify this gap, we introduce Entity-Context Divergence (ECD), a metric that measures the extent to which retrieved information is accurately reflected in model outputs. We systematically evaluate contemporary LLMs on their ability to preserve factual consistency in retrieval-augmented settings, a capability we define as RAG-ability. Our empirical analysis reveals that RAG-ability remains low across most LLMs, highlighting significant challenges in entity retention and context fidelity. This paper introduces Radiant (Retrieval AugmenteD entIty-context AligNmenT), a novel framework that merges RAG with alignment designed to optimize the interplay between retrieved evidence and generated content. Radiant extends Direct Preference Optimization (DPO) to teach LLMs how to integrate provided additional information into subsequent generations. As a behavior correction mechanism, Radiant boosts RAG performance across varied retrieval scenarios, such as noisy web contexts, knowledge conflicts, and hallucination reduction. This enables more reliable, contextually grounded, and factually coherent content generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。