通过标注对话重要性,让大模型找回丢掉的对话可靠性。
SeDT: Sentence-Transformer Decision-Transformer Conditioning for Multi-Turn Conversation Reliability

- 用语义、词汇、位置三信号给对话片段打分,标记关键信息。
- 在多轮对话中最高提升37.7%表现,同时降低112%的不可靠性。
- 无需训练、不改模型,适合所有大语言模型快速部署。
大语言模型在单轮任务中表现优异,但在多轮逐步揭示任务时性能下降高达39%,这一现象被称为‘对话迷失’(Lost in Conversation)。关键问题是可靠性崩溃:尽管模型能力仅下降16%,但不可靠性却上升了112%。我们指出根本原因在于对话历史结构扁平,所有历史回合被赋予同等隐含权重,导致模型无法区分关键约束与无关对话。为此提出SeDT——一种无需训练的推理时方法,借鉴离线强化学习中的return-to-go条件机制。SeDT利用语义、词汇和位置三类互补信号,为每个对话片段生成累积相关性得分,并将完整标注的历史传递给模型,不修改权重、不使用训练数据、不丢弃上下文。在三个LLM和三个生成任务上的实验表明,SeDT在全部九种组合中均优于分片基线,平均性能提升最高达+37.7%,且七组中同时降低不可靠性。结论:只需告诉模型哪些历史回合重要,就能显著恢复对话中丢失的性能。
原文摘要 · Abstract (English)
Large language models (LLMs) achieve impressive performance when a task is fully specified in a single turn, yet the same models lose up to 39% of that performance when the identical task is revealed incrementally across multiple turns, a phenomenon documented at scale as Lost in Conversation. Crucially, this collapse is almost entirely a reliability failure; the best case, the aptitude only falls 16%, while the unreliability more than doubles (+112%). We argue that the root cause is structural, a flat conversation history assigns equal implicit weight to every prior turn, giving the model no signal to distinguish a critical constraint from incidental dialog. We present SeDT Sentence-transformer Decision-Transformer, a training-free inference-time method that resolves this by importing return-to-go conditioning from offline reinforcement learning. SeDT annotates each conversation shard with a cumulative relevance score derived from three complementary semantic, lexical, and positional signals and presents the full annotated history to the model at the final turn, without weight changes, without training data, and without discarding context. Evaluated on the Lost-in-Conversation benchmark in three LLMs and three generation tasks, SeDT outperforms the sharded baseline in all nine model-task combinations, with gains up to +37.7% in mean performance P and simultaneous reductions in unreliability in seven of the nine combinations. In short, telling the model which past turns matter is sufficient to substantially recover the performance lost in conversation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。