多轮对话中,模型易被单方面叙述误导,丧失独立判断。
Caught in the Story: Narrative Captivity in Multi-turn LLMs Conversation

- 通过构建5078个道德冲突场景,研究多轮对话中叙事对模型判断的影响
- 17个模型在多轮叙述下判断偏差达25个百分点,显著偏离单轮基准
- 揭示偏好优化是主因,现有策略仅部分缓解,适合伦理咨询类研究者
人们越来越多地向大语言模型寻求日常建议,使涉及伦理的个人问题成为实际的道德咨询场景。以往研究多基于单轮判断或高压反驳,难以反映真实咨询情境。现实中,道德冲突常表现为一方持续自我辩护式叙述,形成信息不对称。本文提出“叙事俘获”(narrative captivity)这一失效模式:模型在缺乏对立观点时,将单方面叙述视为完整,无意识认同叙述者立场。为此,我们构建了包含5,078个跨六种道德维度的人际冲突场景的基准测试。在17个大型语言模型上验证,多轮叙述导致最终判断平均偏离单轮基线25个百分点。阶段分析表明,偏好优化是主要成因,四种推理时策略仅能部分缓解。本研究旨在推动具备独立判断能力的伦理咨询型模型发展。
原文摘要 · Abstract (English)
People increasingly turn to large language models (LLMs) for everyday advice, making ethically charged interpersonal problems a practical moral-advisory context. Most prior work has studied this context through single-turn judgments or pressure-laden rebuttals, assumptions that poorly match how guidance is sought in real-world contexts. These assumptions leave unclear whether narration alone, without an explicit opposing position, can shift model judgments during multi-turn moral consultation. Yet real-world moral-conflict conversation often elicits one party's self-justifying account, which can unfold over multiple turns and create information asymmetry. We introduce \textbf{narrative captivity}, a failure mode in which a model treats an unopposed one-sided account as complete and aligns with the narrator's interpretation without seeking missing perspectives. To measure this phenomenon, we build a benchmark of $5{,}078$ interpersonal-conflict scenarios spanning six moral dimensions. Across 17 LLMs, narrative captivity is widespread: end-state judgments under multi-turn narration shift by 25 percentage points on average beyond the matched single-turn baseline. Stage-level analysis identifies preference optimization as a major contributor, while four inference-time strategies provide only partial mitigation. We hope our project fosters LLM advisors that preserve independent judgment in real-world consultation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。