将大模型与教学系统动态结合，提升学生问答满意度与学习参与度。
Bridging LMS and generative AI: dynamic course content integration (DCCI) for enhancing student satisfaction and engagement via the ask ME assistant
- 通过提示工程从Canvas系统实时调取课程内容，增强大模型回答的准确性。
- 120名学生使用后平均满意度达4.65/5，78%认为减少了平台切换。
- 适合关注AI助教可靠性与教学互动平衡的研究者和教育技术开发者。
将大型语言模型（LLMs）与学习管理系统（LMS）融合可提升教育任务自动化与可及性，但幻觉问题仍存。本研究提出动态课程内容集成（DCCI）机制，通过提示工程从Canvas LMS动态检索课程内容并嵌入大模型上下文窗口，使基于大模型的助手Ask ME能提供符合课程语境、减少幻觉的精准回应。基于自我决定理论（自主性、胜任感）与技术接受模型（感知有用性、易用性），对埃克塞特洛兰大学120名大一编程学生开展混合方法试点研究。课程涵盖C#基础编程模式与程序规范编写。分析14,746条交互日志及101名学生的课后问卷。用户满意度采用五级李克特量表（逐轮评分），问卷评估可用性、参与度与伦理担忧。结果显示满意度高（均值4.65/5），多数学生认可Ask ME能及时响应行政与课程相关问题；78.06%认为其与Canvas集成减少了平台切换，提升了可用性、参与度、理解力与主题探索。部分学生表示提问顾虑降低，自主学习动机增强，但亦有过度依赖AI与师生互动减少的担忧。研究证明DCCI能提升大模型在教育自动化中的可靠性、学生满意度与参与度，强调需平衡技术应用与人际互动。
原文摘要 · Abstract (English)
Integration of Large Language Models (LLMs) with Learning Management Systems (LMSs) can enhance task automation and accessibility in education. However, hallucination where LLMs generate inaccurate or misleading information remains a challenge. This study introduces the Dynamic Course Content Integration (DCCI) mechanism, which dynamically retrieves course content from Canvas LMS and structures it within an LLM's context window via prompt engineering, enabling the LLM-powered assistant, Ask ME, to deliver context-aware, curriculum-aligned responses while mitigating hallucinations. A mixed-methods pilot study grounded in Self-Determination Theory (autonomy, competence) and the Technology Acceptance Model (perceived usefulness, ease of use) evaluated DCCI's effectiveness with 120 first-year programming students at Eötvös Loránd University. The course focused on foundational programming patterns in C#, including writing program specifications. We analyzed 14,746 logged interactions and a post-course survey completed by 101 students. User satisfaction was measured via a 5-point Likert scale (turn-level ratings), while the survey assessed usability, engagement, and ethical concerns. Results indicated high satisfaction (mean 4.65/5) and strong recognition of Ask ME's ability to provide timely, contextually relevant answers to administrative and course-related queries. 78.06% agreed that Ask ME's Canvas integration reduced platform switching, improving usability, engagement, comprehension, and topic exploration. Many students reported reduced hesitation to ask questions and increased motivation for self-directed learning, though concerns about over-reliance on AI and reduced student-teacher interaction emerged. This study demonstrates that DCCI enhances LLM reliability, student satisfaction, and engagement in AI-driven educational automation, while highlighting the importance of balancing
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。