分析技术问答对话中共识错位如何影响任务成功率。
Understanding Common Ground Misalignment in Goal-Oriented Dialog: A Case-Study with Ubuntu Chat Logs
- 通过分析Ubuntu IRC日志，发现共识错位是对话失败主因。
- 共识错位导致对话摩擦，与任务成功显著相关。
- 大模型难识别需语境或领域知识的微妙摩擦。
尽管共识维持被认为对对话成功至关重要，但此前研究极少将对话共识与任务导向型对话的成功关联起来。本文研究了在Ubuntu IRC数据集中，参与者通过纯文本沟通解决技术问题时的共识失效问题。发现对话流程中断往往源于参与者信念和假设的分歧，这种现象被称为对话摩擦，与任务成功率显著相关。尽管大语言模型能识别明显的对话摩擦，但在需要语用或领域特定推理的细微、上下文依赖性摩擦上表现不佳。
原文摘要 · Abstract (English)
While it is commonly accepted that maintaining common ground plays a role in conversational success, little prior research exists connecting conversational grounding to success in task-oriented conversations. We study failures of grounding in the Ubuntu IRC dataset, where participants use text-only communication to resolve technical issues. We find that disruptions in conversational flow often stem from a misalignment in common ground, driven by a divergence in beliefs and assumptions held by participants. These disruptions, which we call conversational friction, significantly correlate with task success. We find that although LLMs can identify overt cases of conversational friction, they struggle with subtler and more context-dependent instances requiring pragmatic or domain-specific reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。