LLM在多轮对话中走丢,因用户意图与模型理解不匹配。
Intent Mismatch Causes LLMs to Get Lost in Multi-Turn Conversation
- 用中介助手将模糊意图转化为明确指令
- 多轮对话性能显著提升,跨模型通用
- 揭示问题本质是交互失配而非模型能力不足
多轮对话已成为大语言模型(LLMs)的主要交互范式。用户常通过追问细化意图,期望模型动态适应。然而,近期研究发现,相较于完整指令的单轮交互,LLMs在多轮设置下性能大幅下降,这一现象被称为“对话迷失”(Lost in Conversation, LiC)。尽管已有工作将LiC归因于模型不可靠性,我们提出其根源在于意图对齐缺口,而非内在能力缺陷。本文首次证明,LiC并非模型能力问题,而是用户与模型间交互失效所致。理论分析表明,单纯扩大模型规模或改进训练无法解决该缺口,因其源于对话上下文的结构性歧义,而非表征限制。为此,我们提出基于经验驱动的中介-助手架构(Mediator-Assistant),通过中介模块根据历史交互模式将用户输入解析为明确、结构化的指令,有效弥合模糊意图与模型理解之间的差距。实验结果表明,该方法在多种LLMs上显著缓解了多轮对话中的性能退化。
原文摘要 · Abstract (English)
Multi-turn conversation has emerged as a predominant interaction paradigm for Large Language Models (LLMs). Users often employ follow-up questions to refine their intent, expecting LLMs to adapt dynamically. However, recent research reveals that LLMs suffer a substantial performance drop in multi-turn settings compared to single-turn interactions with fully specified instructions, a phenomenon termed ``Lost in Conversation'' (LiC). While this prior work attributes LiC to model unreliability, we argue that the root cause lies in an intent alignment gap rather than intrinsic capability deficits. In this paper, we first demonstrate that LiC is not a failure of model capability but rather a breakdown in interaction between users and LLMs. We theoretically show that scaling model size or improving training alone cannot resolve this gap, as it arises from structural ambiguity in conversational context rather than representational limitations. To address this, we propose to decouple intent understanding from task execution through a Mediator-Assistant architecture. By utilizing an experience-driven Mediator to explicate user inputs into explicit, well-structured instructions based on historical interaction patterns, our approach effectively bridges the gap between vague user intent and model interpretation. Experimental results demonstrate that this method significantly mitigates performance degradation in multi-turn conversations across diverse LLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。