让对话模型学会主动回忆关键信息,提升长对话一致性
Improving Multi-turn Dialogue Consistency with Self-Recall Thinking

- 通过自回忆链构建历史依赖关系,动态筛选有用上下文
- 比之前方法准确率提升4.7%,推理延迟降低14.7%
- 适合需要高一致性和低延迟的长程对话系统
基于大语言模型的多轮对话系统常难以追踪非相邻轮次间的依赖关系,导致一致性下降且可扩展性受限。随着对话延长,关键信息变得稀疏并被无关内容淹没,而处理完整对话历史又带来严重效率瓶颈。现有方法或依赖高延迟外部记忆,或通过迭代摘要丢失细粒度信息。本文提出自回忆思维(SRT)框架,解决多轮对话中的长距离上下文依赖与稀疏信息信号问题。SRT通过识别有益的历史回合,并利用其生成语境恰当的回复,实现推理过程中对上下文的选择性回忆与推理。该过程形成内生推理机制,无需外部模块即可实现可解释的回忆步骤。SRT包含:(1) 依赖关系构建:生成并转换为自回忆链;(2) 能力初始化:训练使推理链具备回忆标记能力;(3) 推理优化:通过可验证奖励提升准确性,优化回忆与推理以获得正确答案。在多个数据集上的实验表明,SRT相比先前方法提升F1分数4.7%,端到端延迟降低14.7%,在推理延迟与准确率之间取得良好平衡,优于当前最优基线。
原文摘要 · Abstract (English)
Large language model (LLM) based multi-turn dialogue systems often struggle to track dependencies across non-adjacent turns, undermining both consistency and scalability. As conversations lengthen, essential information becomes sparse and is buried in irrelevant context, while processing the entire dialogue history incurs severe efficiency bottlenecks. Existing solutions either rely on high latency external memory or lose fine-grained details through iterative summarization. In this paper, we propose Self-Recall Thinking (SRT), a framework designed to address long-range contextual dependency and sparse informative signals in multi-turn dialogue. SRT identifies helpful historical turns and uses them to generate contextually appropriate responses, enabling the model to selectively recall and reason over context during inference. This process yields an endogenous reasoning process that integrates interpretable recall steps without external modules. SRT incorporates: (1) Dependency Construction: Generating and converting it into self-recall chains; (2)Capability Initialization: Training to enable reasoning chains with recall tokens capability; (3)Reasoning Improvement: Refining accuracy via verifiable rewards to optimize recall and reasoning for correct answers. Experiments on multiple datasets demonstrate that SRT improves F1 score by 4.7% and reduces end-to-end latency by 14.7% over prior methods, achieving a balance between reasoning latency and accuracy, and outperforming state-of-the-art baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。