arXiv:2510.22272cs.CL2025-10中稿 · NSLP @ LREC 2026被引 2

用大学课程材料提升大模型答疑能力,效果优于传统训练方法。

From Slides to Chatbots: Enhancing Large Language Models with University Course Materials

  • 用检索增强生成(RAG)融合课件,比持续预训练更有效。
  • 将课件以图像形式检索,答对率比纯文本高12.3%。
  • 适合开发智能教学助手,尤其适用于理工科课程辅导。

近年来大语言模型发展迅速,已开始应用于支持学生学习。然而,现有研究显示,大模型在回答大学计算机科学课程问题时仍存在准确率不足的问题。本文探究如何通过整合大学课程资料(如讲义和录音转录稿)来提升大模型在该场景下的表现。课程资料包含大量图文内容与口语化非结构化语言,与常规语料差异显著。我们比较了检索增强生成(RAG)与持续预训练(CPT)两种方法,并针对讲义进一步提出多模态RAG策略——将检索到的内容以图像形式呈现给生成器。实验表明,在课程资料规模较小的情况下,RAG比CPT更高效且效果更优;且采用图像形式的多模态检索使性能显著优于纯文本检索。这些结果为构建更有效的智能教学辅助系统提供了实用路径,也启发了其他教育场景的应用探索。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have advanced rapidly in recent years. One application of LLMs is to support student learning in educational settings. However, prior work has shown that LLMs still struggle to answer questions accurately within university-level computer science courses. In this work, we investigate how incorporating university course materials can enhance LLM performance in this setting. A key challenge lies in leveraging diverse course materials such as lecture slides and transcripts, which differ substantially from typical textual corpora: slides also contain visual elements like images and formulas, while transcripts contain spoken, less structured language. We compare two strategies, Retrieval-Augmented Generation (RAG) and Continual Pre-Training (CPT), to extend LLMs with course-specific knowledge. For lecture slides, we further explore a multi-modal RAG approach, where we present the retrieved content to the generator in image form. Our experiments reveal that, given the relatively small size of university course materials, RAG is more effective and efficient than CPT. Moreover, incorporating slides as images in the multi-modal setting significantly improves performance over text-only retrieval. These findings highlight practical strategies for developing AI assistants that better support learning and teaching, and we hope they inspire similar efforts in other educational contexts.

大模型教育AI多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。