用AI提问促进学生思考,提升学习效果和高阶思维能力。
Socratic Mind: Impact of a Novel GenAI-Powered Assessment Tool on Student Learning and Higher-Order Thinking
- 通过Socratic提问式AI工具引导学生深度思考
- 使用该工具的学生测验成绩显著提升,尤其基础较弱者受益更大
- 适合关注AI辅助教学与高阶思维培养的教育研究者
本研究考察了Socratic Mind——一种基于生成式人工智能(GenAI)的形成性评估工具在大规模全在线本科计算机课程中的应用效果。该工具采用苏格拉底式提问方式支持学生学习。研究采用准实验混合方法设计,收集系统日志、用户体验与学习感知问卷、学生反思文本及课程表现数据。结果显示,参与者普遍报告情感、行为与认知层面高度参与,且与积极体验和学习感知正相关。量化分析表明,使用GenAI工具的学生测验成绩显著优于未使用者,尤其对基线成绩较低的学生提升更明显。质性反馈的主主题分析显示,学生普遍感受到问题解决、批判性思维与自我反思等高阶思维能力的显著提升。研究证明,基于AI的对话式教学可有效促进深度参与与高阶认知发展。随着高校持续推进GenAI融入课程,此类对话式评估工具为实现有意义学习提供了可扩展的策略。
原文摘要 · Abstract (English)
This study examines the impact of Socratic Mind, a Generative Artificial Intelligence (GenAI) powered formative assessment tool that employs Socratic questioning to support student learning in a large, fully online undergraduate-level computing course. Employing a quasi-experimental, mixed-methods design, we investigated participants' engagement patterns, the influence of user experience on engagement, and impacts on both perceived and actual learning outcomes. Data were collected from the system logs, surveys on user experience and perceived engagement and learning gains, student reflections, and course performance data. Results indicated that participants consistently reported high levels of affective, behavioral, and cognitive engagement, and these were strongly linked to positive user experiences and perceived learning outcomes. Quantitative analysis further revealed that students who engaged with the GenAI tool experienced significant gains in their quiz scores compared to those who did not, particularly benefiting students with lower baseline achievement. Additionally, thematic analysis of qualitative feedback revealed substantial perceived improvements in higher-order thinking skills, including problem solving, critical thinking, and self-reflection. Our findings highlight the promise of AI-mediated dialogue in fostering deeper engagement and higher-order cognitive skills. As higher education institutions expand GenAI integration in curriculum, this dialogic, GenAI powered assessment tool can offer a scalable strategy to promote students' meaningful learning outcomes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。