用大模型分析学生对话,自动识别协作学习中的共同调节行为。
Using Large Language Models to Detect Socially Shared Regulation of Collaborative Learning
- 用大模型生成任务相关的对话摘要,融合文本与系统日志特征。
- 纯文本嵌入在检测离题、求助等行为上表现更优,上下文特征利于规划与反思预测。
- 适合教育技术研究者和智能辅导系统开发者参考。
学习分析领域在多模态数据中自动化检测复杂学习过程方面取得了显著进展,但多数研究聚焦于个体化问题解决,而非协作式开放式问题解决。本文拓展预测模型,利用基于嵌入的方法,在协作计算建模环境中自动检测社会共享学习调节(SSRL)行为。通过大语言模型(LLMs)作为摘要工具,生成与系统日志对齐的任务感知对话表示。这些摘要结合纯文本嵌入、上下文增强嵌入及日志衍生特征,用于训练预测模型。结果表明,纯文本嵌入在检测执行或群体动态相关行为(如离题行为或请求帮助)方面表现更优;而上下文与多模态特征则对规划与反思类构念提供互补优势。整体而言,研究证明嵌入模型在扩展学习分析方面的潜力,可实现对SSRL行为的可扩展检测,支持教师重视的实时反馈与自适应支架。
原文摘要 · Abstract (English)
The field of learning analytics has made notable strides in automating the detection of complex learning processes in multimodal data. However, most advancements have focused on individualized problem-solving instead of collaborative, open-ended problem-solving, which may offer both affordances (richer data) and challenges (low cohesion) to behavioral prediction. Here, we extend predictive models to automatically detect socially shared regulation of learning (SSRL) behaviors in collaborative computational modeling environments using embedding-based approaches. We leverage large language models (LLMs) as summarization tools to generate task-aware representations of student dialogue aligned with system logs. These summaries, combined with text-only embeddings, context-enriched embeddings, and log-derived features, were used to train predictive models. Results show that text-only embeddings often achieve stronger performance in detecting SSRL behaviors related to enactment or group dynamics (e.g., off-task behavior or requesting assistance). In contrast, contextual and multimodal features provide complementary benefits for constructs such as planning and reflection. Overall, our findings highlight the promise of embedding-based models for extending learning analytics by enabling scalable detection of SSRL behaviors, ultimately supporting real-time feedback and adaptive scaffolding in collaborative learning environments that teachers value.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。