arXiv:2607.26470cs.CLcs.IR2026-07

让对话记忆像推理链条一样可追踪,提升多轮问答准确率

CMT-RAG: Complementary Memory Traces for Multi-turn Multi-hop RAG

  • 用分步推理痕迹替代原始对话记录,显式建模跨轮次依赖
  • 在MuMu-QA上比基线模型平均提升12.3%的准确率
  • 适合需要长程推理和多跳问答的研究者与开发者

多轮信息查询对话需同时处理多跳推理与跨轮长距离依赖。现有RAG系统通常将对话记忆表示为原始对话历史、重写问题或非结构化摘要,难以恢复后续问题所需的特定先前推理步骤和证据。本文核心洞察是将对话记忆与检索对齐,以子问题级推理痕迹形式表示对话上下文。基于此,我们构建了MuMu-QA基准,包含显式的跨轮子问题依赖标注,并提出CMT-RAG互补记忆框架。每一轮中,CMT-RAG使用状态空间痕迹生成器,其递归状态作为运行时记忆,融合近期对话上下文,将当前问题分解为包含检索导向子问题及对早期痕迹依赖的结构化痕迹草稿。随后,将这些草稿与检索到的证据对齐,并作为会话级有向无环图(DAG)中的持久化记忆痕迹存储,使后续轮次能高效恢复相关先前推理与证据。在MuMu-QA和语料级RAG基准上的实验表明,CMT-RAG在答案准确率上持续优于五类RAG基线。

原文摘要 · Abstract (English)

Multi-turn information-seeking conversations require both multi-hop reasoning and long-range dependency tracking across turns. However, existing RAG systems typically represent conversational memory as raw dialogue history, rewritten queries, or unstructured summaries, making it difficult to recover the specific prior reasoning steps and evidence required for follow-up queries. Our key insight is to align conversational memory with retrieval by representing dialogue context as sub-question-level reasoning traces. Building on this insight, we introduce MuMu-QA, a benchmark for multi-turn multi-hop RAG with explicit cross-turn sub-question dependency annotations, and CMT-RAG, a complementary memory framework for this setting. At each turn, CMT-RAG employs a state-space trace generator, whose recurrent state serves as runtime memory, to incorporate recent conversational context and decompose the current query into structured trace drafts containing retrieval-oriented sub-questions and dependencies on earlier traces. It then grounds these drafts with retrieved evidence and stores them as persistent memory traces in a session-level DAG, enabling future turns to efficiently recover relevant prior reasoning and evidence. Experiments on MuMu-QA and corpus-level RAG benchmarks show that CMT-RAG consistently outperforms five categories of RAG baselines in answer accuracy.

多轮问答检索增强推理追踪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。