arXiv:2605.23668cs.CLcs.AI2026-05被引 2

用递归记忆预测对话下一步,省 token 又准

OnePred: Next-Query Prediction via Recursive Intent Memory in Multi-Turn Conversations

论文配图:OnePred: Next-Query Prediction via Recursive Intent Memory in Multi-Turn Conversations
图 1 · 摘自论文原文
  • 用递归记忆追踪用户意图变化,不读完整对话
  • 每轮耗时仅原方法的1/22,长对话更优
  • 适合想提升对话效率的系统开发者

尽管大语言模型对话系统每日处理数百万次多轮对话,仍处于被动响应状态:仅在用户输入后才回应。实现主动交互的关键是下一步查询预测,即仅基于历史对话预测用户后续问题。该任务进展受限于缺乏专用基准与效率-质量权衡:直接拼接全部历史导致令牌消耗线性增长,而只保留最新一轮又丢弃跨轮次上下文。我们提出,准确预测无需重读原始历史,只需跟踪用户在话题、未解决需求和兴趣变化上的意图轨迹。为此,我们设计 OnePred,仅用递归更新的记忆作为跨轮上下文,使每轮成本独立于对话长度。通过两阶段强化学习训练,先学预测目标,再学压缩策略,将记忆塑造成面向预测的意图链。为建立严格测试基准,我们引入 NQP-Bench,涵盖三个不同子集。实验表明,OnePred 在保持预测质量超越所有基线的同时,每轮令牌消耗相比全历史输入最多降低22倍,长对话中优势更显著。代码已公开于 https://github.com/ZBWpro/OnePred。

原文摘要 · Abstract (English)

Although large language model (LLM) conversational systems process millions of multi-turn dialogues daily, they remain fundamentally reactive: they respond only after the user types a query. A key step toward proactive interaction is next-query prediction, which anticipates the user's subsequent query based solely on the preceding dialogue. Progress on this task is hindered by the lack of dedicated benchmarks and a fundamental efficiency--quality trade-off: naively concatenating full dialogue history incurs linearly growing token consumption, while truncating to the latest turn discards crucial cross-turn context. Our key insight is that accurate prediction does not require re-reading raw history; it suffices to track the user's evolving intent trajectory across topics, unresolved needs, and interest shifts. We propose OnePred, which maintains a recursively updated memory as its sole cross-turn context, bounding the per-turn cost independently of conversation length. We train the model via a two-stage reinforcement learning pipeline that first teaches what to predict, then what to compress, shaping the memory into a prediction-oriented intent chain. To establish a rigorous testbed, we introduce NQP-Bench, spanning three diverse subsets. Experiments demonstrate that OnePred reduces per-turn token consumption by up to 22$\times$ compared to full-history inputs while consistently exceeding all baselines in prediction quality, with larger gains on longer conversations. Our code is publicly available at https://github.com/ZBWpro/OnePred.

对话系统意图追踪高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。