arXiv:2510.22844cs.CL2025-10被引 1

用大模型识别协作对话中的话题线,提升分析准确性

Leveraging Large Language Models to Identify Conversation Threads in Collaborative Learning

  • 设计对话线识别指南,指导大模型追踪同步对话中的话题链
  • 提供清晰话题结构后,大模型在协作行为识别上准确率显著提升
  • 适合教育技术、人机协作研究者参考,尤其关注实时对话分析

理解小组对话中思想的发展与流动是分析协作学习的关键。对话的结构性特征之一是话题线,即话语自然组织成随时间演变的交织主题流。尽管话题线在异步文本中已有广泛研究,但在同步口语对话中因话语重叠和隐含线索而难以检测。与此同时,大语言模型虽有潜力自动化话语分析,却常因长上下文依赖而表现不佳。本文探究显式话题链接是否能改善大模型对群体对话中关系性行为的标注。我们提出系统化的同步多角色对话话题识别指南,并基准测试了不同大模型提示策略的自动话题划分效果。进一步检验话题结构对下游协作行为分析(如同意、构建、提问)编码性能的影响。结果表明,提供明确的话题信息可显著提升大模型性能,凸显下游分析对良好对话结构的高度依赖。同时讨论了时间与成本的实际权衡,强调人机协同在某些场景下的最优价值。本研究推动了大模型与稳健对话结构结合,以解析复杂实时群体互动。

原文摘要 · Abstract (English)

Understanding how ideas develop and flow in small-group conversations is critical for analyzing collaborative learning. A key structural feature of these interactions is threading, the way discourse talk naturally organizes into interwoven topical strands that evolve over time. While threading has been widely studied in asynchronous text settings, detecting threads in synchronous spoken dialogue remains challenging due to overlapping turns and implicit cues. At the same time, large language models (LLMs) show promise for automating discourse analysis but often struggle with long-context tasks that depend on tracing these conversational links. In this paper, we investigate whether explicit thread linkages can improve LLM-based coding of relational moves in group talk. We contribute a systematic guidebook for identifying threads in synchronous multi-party transcripts and benchmark different LLM prompting strategies for automated threading. We then test how threading influences performance on downstream coding of conversational analysis frameworks, that capture core collaborative actions such as agreeing, building, and eliciting. Our results show that providing clear conversational thread information improves LLM coding performance and underscores the heavy reliance of downstream analysis on well-structured dialogue. We also discuss practical trade-offs in time and cost, emphasizing where human-AI hybrid approaches can yield the best value. Together, this work advances methods for combining LLMs and robust conversational thread structures to make sense of complex, real-time group interactions.

对话分析大模型协作学习话题线

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。