短期结构化训练提升本科生对生成式AI的使用信心与策略
A Scaffolded GenAI Lab in Early Undergraduate CS: A Mixed-Methods, Multi-Course Evaluation
- 设计阶梯式AI实验课,包含课前引导、课堂批判性分析和作业反思
- 学生对概念理解、调试和作业求助的使用意愿明显提升,但实际使用频率未上升
- 适合初学编程的学生和希望引导学生负责任使用AI的教育者
生成式AI工具在编程课程中日益普及,但关于短期教学如何促进负责任、以学习为导向的使用仍缺乏证据。本文评估了名为「AI-Lab」的阶梯式生成式AI素养干预措施,探究学生参与后对生成式AI在概念理解、调试和作业任务中的自我报告使用情况、开放度与舒适度的变化。研究覆盖美国一所大学的两学期中三门计算机科学课程及一门大一工程课程,共收集831份感知类问卷、826份使用类问卷,并开展六场焦点小组访谈;主要推断分析基于三门计算机科学课程(分别为778人和773人)。通过配对非参数检验分析问卷变化,采用主题分析法处理访谈内容。结果显示:学生在概念理解、作业帮助方面的开放度上升,调试、概念理解及作业场景中的舒适度也显著提高;自述在作业和项目中使用生成式AI的频率保持稳定,但调试场景下的使用频率增加。焦点小组参与者提到采用更迭代的提示策略、对输出正确性更加怀疑,并能清晰界定学术诚信与依赖边界。研究表明,短时结构化干预可改变学生对生成式AI的态度与使用策略,而不显著提升在正式作业中的使用频率。该结果为未来结合行为数据与学习成效的多维验证提供依据。
原文摘要 · Abstract (English)
Background and Context. Generative AI (GenAI) tools are increasingly used in programming courses, but we have limited evidence about how brief instruction can foster responsible, learning-oriented use. Objectives. We evaluate "AI-Lab", a scaffolded GenAI literacy intervention, asking how students' self-reported GenAI usage and their openness and comfort using GenAI for conceptual, debugging, and homework tasks change after participation. Methods. Across two semesters in three CS courses and one first-year engineering course at a U.S. university, we deployed the "AI-Lab" (pre-lab orientation, in-class critique of GenAI outputs, and a required homework reflection), collecting paired pre/post surveys (Perception N=831; Usage N=826) and six post-intervention focus groups; primary inferential analyses used the three CS courses (N=778 and 773, respectively). We analyzed survey shifts with paired non-parametric tests and focus groups via thematic analysis. Findings. Openness increased for conceptual questions and homework help, and comfort increased for conceptual, debugging, and homework scenarios; self-reported frequency of GenAI use for homework and projects remained stable, while self-reported use for debugging increased. Focus group participants described adopting more iterative prompting strategies, becoming more skeptical of correctness, and articulating clearer boundaries around integrity and dependence. Implications. A short, structured intervention can shift students' reported comfort with and willingness to use GenAI and influence the strategies they describe for engaging with it without increasing overall self-reported use on graded work. These results motivate future work triangulating surveys with behavioral traces and learning measures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。