用AI分析学生评教,帮工程学院规模化提升教学质量。
Teaching at Scale: Leveraging AI to Evaluate and Elevate Engineering Education
- 用大模型分层提炼学生开放评语中的关键主题
- 生成可比对的可视化报告,支持教学改进决策
- 适合高校教育评估团队和教师发展中心使用
大规模高校工程教育中,教学效果评估长期面临挑战,传统人工评阅方式难以应对数万名学生的反馈。本文提出一种基于大语言模型的可扩展框架,通过层级化摘要、匿名化处理与异常检测,从开放式评论中提取可行动的主题,同时保障伦理安全。可视化分析结合百分位对比、历史趋势与授课负荷,使量化评分更具上下文意义。该系统整合学生、同行及自我反思评价,不替代人事决策,已成功部署于大型工程学院。初步验证显示,模型生成摘要在与人工评审对照、教师反馈及纵向分析中表现可靠,能有效支撑形成性评价与教师专业成长。研究证明,只要设计透明并实行共治,AI系统可在高校实现教学卓越与持续改进。
原文摘要 · Abstract (English)
Evaluating teaching effectiveness at scale remains a persistent challenge for large universities, particularly within engineering programs that enroll tens of thousands of students. Traditional methods, such as manual review of student evaluations, are often impractical, leading to overlooked insights and inconsistent data use. This article presents a scalable, AI-supported framework for synthesizing qualitative student feedback using large language models. The system employs hierarchical summarization, anonymization, and exception handling to extract actionable themes from open-ended comments while upholding ethical safeguards. Visual analytics contextualize numeric scores through percentile-based comparisons, historical trends, and instructional load. The approach supports meaningful evaluation and aligns with best practices in qualitative analysis and educational assessment, incorporating student, peer, and self-reflective inputs without automating personnel decisions. We report on its successful deployment across a large college of engineering. Preliminary validation through comparisons with human reviewers, faculty feedback, and longitudinal analysis suggests that LLM-generated summaries can reliably support formative evaluation and professional development. This work demonstrates how AI systems, when designed with transparency and shared governance, can promote teaching excellence and continuous improvement at scale within academic institutions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。