arXiv:2603.11394cs.CLcs.AI2026-03

多轮对话会严重降低大模型可靠性,尤其在医疗场景中表现下滑明显。

Stop Listening to Me! How Multi-turn Conversations Can Degrade LLM Reliability

  • 提出'留或换'框架,量化模型在对话中坚持正确答案或放弃错误建议的能力
  • 多轮对话使准确率和拒答错误建议能力平均下降30%,部分模型达65%
  • 模型越大越难保持判断力,可能从不回答直接转向错误回答

大型语言模型在静态基准测试中表现优异,但在反映真实使用场景的多轮对话中性能仍缺乏研究。在医疗等高风险领域,患者与医生正依赖聊天机器人解答医学问题。本文提出“留或换”(SoS)框架,将问答空间划分为多个序列呈现,以建模两种安全行为:坚持正确选择或拒绝错误建议(信念坚定),以及在新正确建议出现时切换(灵活应变)。在三个临床基准上评估17个LLM发现,存在普遍的对话代价:将答案空间分步呈现后,整体准确率和拒绝错误建议的能力平均下降高达30%,某些模型甚至达到65%。此外观察到“盲切”现象:模型从初始拒绝状态切换至错误或正确建议的速率几乎相同,达50%。最后发现,增大模型规模虽缓解部分对话缺陷,但加剧了从初始拒绝转为采纳错误建议的倾向。结果表明,静态基准衡量的通用能力无法迁移至多轮对话场景。

原文摘要 · Abstract (English)

Large language models (LLMs) excel on static benchmarks, but their performance across multi-turn conversations, which better reflect real-world usage, remains understudied. Addressing this gap is critical in high-stakes settings like healthcare, where patients and clinicians are turning to LLM chatbots to address their medical inquiries. Here, we introduce the "stick-or-switch" (SoS) framework, which partitions a question-answer space into multiple sequential presentations to model two safety-centric behaviors: conviction (i.e., sticking to a correct answer selection or abstention against incorrect suggestions) and flexibility (i.e., switching to a correct suggestion when it is introduced). Evaluating 17 LLMs across three clinical benchmarks, we observe a pervasive conversation tax, where partitioning an answer-space into sequential presentations reduces end-to-end accuracy and abstention against incorrect suggestions by an average of up to 30%, reaching 65% in certain models. We also observe blind switching, where models transition an initial abstention to incorrect and correct suggestions at near-identical rates reaching 50%. Finally, we show that increasing model scale mitigates some of these conversational inefficacies while exacerbating others, such as a higher propensity to adopt an incorrect suggestion from an initial abstention. Together our findings demonstrate that the general proficiency captured by static benchmarks do not translate over multi-turn dialogues.

大模型对话系统可靠性医疗AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。