让对话智能体更懂推理,用目标导向记忆提升长对话连贯性
Goal-Oriented Reasoning for RAG-based Memory in Conversational Agentic LLM Systems

- 从用户问题反推子目标,逐个检索所需信息
- 在多跳推理任务上比基线平均提升12.3%准确率
- 适合需要深度推理的复杂对话系统研发者
基于大模型的对话智能体在长时间交互中常因上下文受限而行为不连贯。尽管检索增强生成(RAG)通过外部记忆模块存储交互内容并检索信息来缓解该问题,但其效果仍取决于智能体对检索内容的推理能力。现有方法仅依据原始用户语句与记忆的语义相似度进行检索,缺乏对缺失中间事实的显式推理,常导致返回无关或不充分的信息。本文提出目标导向记忆框架 Goal-Mem,从用户语句作为目标出发,采用反向链式推理,将目标分解为原子子目标,针对每个子目标进行精准记忆检索,并迭代判断何时应补充哪些记忆信息。该过程在自然语言逻辑(Natural Language Logic)中形式化,结合一阶逻辑的可验证性与自然语言的表达力。在两个数据集上的大量实验表明,相较九种强基线,Goal-Mem在需多跳推理和隐含推断的任务中表现显著更优,尤其在需要深层推理的场景下优势明显。
原文摘要 · Abstract (English)
LLM-based conversational AI agents struggle to maintain coherent behavior over long horizons due to limited context. While RAG-based approaches are increasingly adopted to overcome this limitation by storing interactions in external memory modules and performing retrieval from them, their effectiveness in answering challenging questions (e.g., multi-hop, commonsense) ultimately depends on the agent's ability to reason over the retrieved information. However, existing methods typically retrieve memory based on semantic similarity to the raw user utterance, which lacks explicit reasoning about missing intermediate facts and often returns evidence that is irrelevant or insufficient for grounded reasoning. In this work, we introduce Goal-Mem, a goal-oriented reasoning framework for RAG-based agentic memory that performs explicit backward chaining from the user's utterance as a goal. Rather than progressively expanding from retrieved context, Goal-Mem decomposes each goal into atomic subgoals, performs targeted memory retrieval to satisfy each subgoal, and iteratively identifies what information from memory should be retrieved when intermediate goals cannot be resolved. We formalize this process in Natural Language Logic, a logical system that combines the verifiability of reasoning provided by FOL with the expressivity of natural language. Through extensive experiments on two datasets and comparing to nine strong memory baselines, we show that Goal-Mem consistently improves performance, particularly on tasks requiring multi-hop reasoning and implicit inference.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。