用辩证推理提升多语言检索增强模型的判断力
Improving Multilingual Retrieval-Augmented Language Models through Dialectic Reasoning Argumentations
- 通过结构化论据对比冲突信息,实现批判性推理
- 在多语言数据上显著提升回答准确率,抗干扰能力强
- 适合需要可靠决策的跨语言问答场景
检索增强生成(RAG)是提升大语言模型获取事实知识能力的关键。然而,在多语言检索中,模型需应对异质知识带来的观点冲突。为此,我们提出基于论据解释的辩证检索增强生成(DRAG),通过系统比较、对比和调和不同视角,构建结构化推理过程。针对查询与多语言相关文档,DRAG 选择并示例相关信息,生成辩证解释,通过权衡对立论点并过滤冗余内容,明确最终响应。实验表明,该框架作为上下文学习策略或用于指导小模型训练均有效,显著提升 RAG 性能,计算开销低,且对知识扰动具有强鲁棒性。
原文摘要 · Abstract (English)
Retrieval-augmented generation (RAG) is key to enhancing large language models (LLMs) to systematically access richer factual knowledge. Yet, using RAG brings intrinsic challenges, as LLMs must deal with potentially conflicting knowledge, especially in multilingual retrieval, where the heterogeneity of knowledge retrieved may deliver different outlooks. To make RAG more analytical, critical and grounded, we introduce Dialectic-RAG (DRAG), a modular approach guided by Argumentative Explanations, i.e., structured reasoning process that systematically evaluates retrieved information by comparing, contrasting, and resolving conflicting perspectives. Given a query and a set of multilingual related documents, DRAG selects and exemplifies relevant knowledge for delivering dialectic explanations that, by critically weighing opposing arguments and filtering extraneous content, clearly determine the final response. Through a series of in-depth experiments, we show the impact of our framework both as an in-context learning strategy and for constructing demonstrations to instruct smaller models. The final results demonstrate that DRAG significantly improves RAG approaches, requiring low-impact computational effort and providing robustness to knowledge perturbations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。