arXiv:2601.05589cs.CLcs.AI2026-01ACL被引 1

动态重构对话历史,解决长对话中的记忆失准与事实漂移问题。

ACR: Adaptive Context Refactoring via Context Refactoring Operators for Multi-Turn Dialogue

论文配图:ACR: Adaptive Context Refactoring via Context Refactoring Operators for Multi-Turn Dialogue
图 1 · 摘自论文原文
  • 引入自适应上下文重构框架,通过操作符动态调整对话历史。
  • 在多轮对话中显著提升一致性,减少40%以上令牌消耗。
  • 适合需要长期对话稳定性的智能客服、虚拟助手场景。

大语言模型在多轮对话中表现优异,但仍面临早期内容对齐困难、跨轮依赖难以维持以及随着交互延长出现事实漂移等问题。现有方法主要依赖扩展上下文窗口、引入外部记忆或上下文压缩,但依然存在上下文惯性与状态漂移的局限。为此,我们提出自适应上下文重构(ACR)框架,通过动态监控并重塑对话历史,主动缓解上下文惯性与状态漂移。ACR基于一组上下文重构操作符,并采用教师引导的自进化训练范式,学习何时干预及如何重构,从而将上下文管理与推理过程解耦。在多轮对话上的大量实验表明,该方法显著优于现有基线,同时降低令牌消耗。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have shown remarkable performance in multi-turn dialogue. However, in multi-turn dialogue, models still struggle to stay aligned with what has been established earlier, follow dependencies across many turns, and avoid drifting into incorrect facts as the interaction grows longer. Existing approaches primarily focus on extending the context window, introducing external memory, or applying context compression, yet these methods still face limitations such as \textbf{contextual inertia} and \textbf{state drift}. To address these challenges, we propose the \textbf{A}daptive \textbf{C}ontext \textbf{R}efactoring \textbf{(ACR)} Framework, which dynamically monitors and reshapes the interaction history to mitigate contextual inertia and state drift actively. ACR is built on a library of context refactoring operators and a teacher-guided self-evolving training paradigm that learns when to intervene and how to refactor, thereby decoupling context management from the reasoning process. Extensive experiments on multi-turn dialogue demonstrate that our method significantly outperforms existing baselines while reducing token consumption.

对话系统上下文管理LLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。