对话中互动质量比解释内容更重要,影响学习效果。
Learning Through Dialogue: Engagement and Efficacy Matter More Than Explanations
- 通过分析397场对话,发现解释丰富度靠用户反思来提升信心
- 知识增长完全依赖用户认知投入,高参与度者受益更明显
- 适合关注人机交互设计与教育类AI的读者
大型语言模型(LLMs)越来越多地被用作学习对话伙伴,但支持用户学习与参与的互动机制仍不明确。本研究分析了397场关于社会政治议题的人-模型对话中的语言与互动特征,探究模型解释如何影响政治知识与信心变化。中介分析显示,解释丰富度部分通过促进用户反思性洞察来提升信心,而对知识增长的影响则完全通过用户的认知参与实现。调节分析表明,这些效应高度依赖政治效能感:信心提升取决于高效能用户对不确定性的体验与解决能力;知识增长则依赖高效能用户利用长时间对话的能力,尤其对反思型用户更有利。综上,从模型中学到东西是互动的结果,而非解释质量的直接产物。研究强调在设计人-智能系统时,需根据用户参与状态调整模型行为以支持有效学习。
原文摘要 · Abstract (English)
Large language models (LLMs) are increasingly used as conversational partners for learning, yet the interactional dynamics supporting users' learning and engagement are understudied. We analyze the linguistic and interactional features from both LLM and participant chats across 397 human-LLM conversations about socio-political issues to identify the mechanisms and conditions under which LLM explanations shape changes in political knowledge and confidence. Mediation analyses reveal that LLM explanatory richness partially supports confidence by fostering users' reflective insight, whereas its effect on knowledge gain operates entirely through users' cognitive engagement. Moderation analyses show that these effects are highly conditional and vary by political efficacy. Confidence gains depend on how high-efficacy users experience and resolve uncertainty. Knowledge gains depend on high-efficacy users' ability to leverage extended interaction, with longer conversations benefiting primarily reflective users. In summary, we find that learning from LLMs is an interactional achievement, not a uniform outcome of better explanations. The findings underscore the importance of aligning LLM explanatory behavior with users' engagement states to support effective learning in designing Human-AI interactive systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。