提出自适应记忆优化框架,提升开放域问答中检索增强生成的准确性与效率。
Towards Adaptive Memory-Based Optimization for Enhanced Retrieval-Augmented Generation
- 采用多智能体协同机制动态更新语言模型记忆
- 通过自适应检索策略减少冗余信息,提升知识整合能力
- 适合需要高准确率开放域问答的场景,如智能客服、知识库应用
检索增强生成(RAG)通过将外部知识库中的非参数化知识融入模型,成为提升回答准确性并缓解事实错误与幻觉问题的有前景方法,广泛应用于问答任务。然而,现有RAG方法在开放域问答中表现受限,因其独立执行检索操作,并直接将结果用于生成,缺乏总结性记忆或自适应检索策略,导致冗余信息引入噪声,且知识整合不足。为此,本文提出面向开放域问答的自适应记忆优化框架Amber,包含基于代理的记忆更新器、自适应信息收集器和多粒度内容过滤器,三者在迭代记忆更新范式下协同工作。Amber通过多智能体协作机制整合并优化语言模型记忆,确保前序检索步骤的知识全面融合;动态调整检索查询并依据累积知识决定停止时机,显著提升检索效率与效果;同时在多层级过滤无关内容,保留关键信息以改善整体性能。我们在多个开放域问答数据集上进行了大量实验,结果验证了该方法及其组件的有效性。源代码已公开。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG), by integrating non-parametric knowledge from external knowledge bases into models, has emerged as a promising approach to enhancing response accuracy while mitigating factual errors and hallucinations. This method has been widely applied in tasks such as Question Answering (QA). However, existing RAG methods struggle with open-domain QA tasks because they perform independent retrieval operations and directly incorporate the retrieved information into generation without maintaining a summarizing memory or using adaptive retrieval strategies, leading to noise from redundant information and insufficient information integration. To address these challenges, we propose Adaptive memory-based optimization for enhanced RAG (Amber) for open-domain QA tasks, which comprises an Agent-based Memory Updater, an Adaptive Information Collector, and a Multi-granular Content Filter, working together within an iterative memory updating paradigm. Specifically, Amber integrates and optimizes the language model's memory through a multi-agent collaborative approach, ensuring comprehensive knowledge integration from previous retrieval steps. It dynamically adjusts retrieval queries and decides when to stop retrieval based on the accumulated knowledge, enhancing retrieval efficiency and effectiveness. Additionally, it reduces noise by filtering irrelevant content at multiple levels, retaining essential information to improve overall model performance. We conduct extensive experiments on several open-domain QA datasets, and the results demonstrate the superiority and effectiveness of our method and its components. The source code is available \footnote{https://anonymous.4open.science/r/Amber-B203/}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。