arXiv:2504.08846cs.CYcs.AI2025-04

用AI打造课程专属学习助手,精准匹配工程课内容

AI University: An LLM-Powered Learning Assistant for Engineering---A Finite Element Method Case Study

  • 用微调大模型+检索增强生成,让AI懂课程风格
  • 在有限元课程中,专家模型86%测试项得分更高
  • 适合想定制智能助教的理工科教师与学生

我们提出AI University(AI-U),一个可适应课程教学风格的AI驱动课程内容交付框架。AI-U结合微调的大语言模型(LLM)、检索增强生成(RAG)和推理合成模型,从视频、笔记和教材中生成风格一致的回答。以研究生级有限元方法(FEM)课程为例,构建了合成课程数据、使用低秩适配(LoRA)微调开源LLM并应用RAG合成的全流程。评估显示,相较基线模型,其与课程材料的对齐度显著提升:量化指标下86%测试案例表现更优;LLM评判者在两种提示下均偏好专家模型;高级用户使用调研中,专家模型受青睐概率为基线模型的两倍。课程讲师也认为,在结合推理合成模型后,该专家模型比近期闭源模型更贴合课程内容。我们已开发原型网页应用(https://my-ai-university.com),可为生成回答添加课程章节引用及时间戳视频链接。本框架为基于微调与检索增强的课程专用学习助手提供了实用路径,尤其适用于培养博士与硕士生的工程科学核心课程,具备向其他STEM领域扩展的潜力。

原文摘要 · Abstract (English)

We introduce AI University (AI-U), a flexible framework for AI-driven course content delivery that adapts to a course's instructional style. AI-U combines a fine-tuned large language model (LLM) with retrieval-augmented generation (RAG) and a reasoning synthesis model to generate style-aligned responses from lecture videos, notes, and textbooks. Using a graduate-level finite-element-method (FEM) course as a case study, we present a pipeline to synthesize course-grounded training data, fine-tune an open-source LLM with Low-Rank Adaptation (LoRA), and apply RAG-based synthesis. Our evaluation---combining cosine similarity, LLM-based assessment, expert review, and user studies---shows improved alignment with course materials relative to the base model. We have also developed a prototype web application, available at https://my-ai-university.com, that enhances AI-generated responses with references to relevant sections of the course material and clickable links to time-stamped video lectures. Our expert model is found to be higher scoring by a quantitative measure on 86% of test cases. An LLM judge also preferred our expert model to its base model under both evaluation prompts. Human evaluation by advanced users showed a preference for our expert model approximately twice as often as for the base model. The FEM course instructor found our expert model to achieve better alignment with class-specific content than a recent closed-weight model when both were combined with the reasoning synthesis model. AI-U offers a practical approach to developing course-specific learning assistants using fine-tuned and retrieval-augmented LLMs. By presenting our framework in an FEM class---central to training PhD and master's students in engineering science---we offer a template with potential for extension across STEM fields.

学习助手大模型有限元课程定制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。