arXiv:2508.17862cs.IR2025-08被引 2

让大模型学会记忆和反思,持续优化问答效果。

Retrieval Feedback Memory Enhancement Large Model Retrieval Generation Method

  • 构建动态证据池,让检索过程有记忆、可迭代。
  • 通过关系三元组生成精准问题,减少冗余检索。
  • 适合需要长期知识积累的复杂问答任务。

大语言模型在多种任务中表现卓越,但存在参数化知识受限和重训练成本高等固有问题。检索增强生成(RAG)通过引入外部知识弥补模型内部知识不足。然而,传统RAG在多轮查询中易出现信息丢失和重复检索,难以精确定位复杂任务的知识缺口。为此,我们提出检索反馈与记忆增强生成(RFM-RAG),将先前无状态的检索机制转变为有状态的持续知识管理,通过构建动态证据池实现知识累积。具体而言,该方法利用问题与证据池中的关系三元组生成细化问题,检索关键外部知识并迭代更新证据池;采用R-Feedback模型评估证据完整性直至收敛。相比传统RAG,本方法可持久存储检索片段,并有效提炼关键信息以生成清晰新问题。在三个公开QA基准上的实验表明,RFM-RAG优于现有方法,显著提升系统整体准确率。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have shown remarkable capabilities across diverse tasks, yet they face inherent limitations such as constrained parametric knowledge and high retraining costs. Retrieval-Augmented Generation (RAG) augments the generation process by retrieving externally stored knowledge absent from the models internal parameters. However, RAG methods face challenges such as information loss and redundant retrievals during multi-round queries, accompanying the difficulties in precisely characterizing knowledge gaps for complex tasks. To address these problems, we propose Retrieval Feedback and Memory Retrieval Augmented Generation(RFM-RAG), which transforms the stateless retrieval of previous methods into stateful continuous knowledge management by constructing a dynamic evidence pool. Specifically, our method generates refined queries describing the models knowledge gaps using relational triples from questions and evidence from the dynamic evidence pool; Retrieves critical external knowledge to iteratively update this evidence pool; Employs a R-Feedback Model to evaluate evidence completeness until convergence. Compared to traditional RAG methods, our approach enables persistent storage of retrieved passages and effectively distills key information from passages to construct clearly new queries. Experiments on three public QA benchmarks demonstrate that RFM-RAG outperforms previous methods and improves overall system accuracy.

大模型检索增强知识管理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。