arXiv:2604.03236cs.HCcs.CL2026-04被引 1

用对话引导学生查资料,比直接给答案更有效。

BLADE: Better Language Answers through Dialogue and Explanations

  • 基于检索增强生成,用引用引导学生查找课程资料。
  • 单独使用BLADE时测验成绩最高,混合使用反而下降。
  • 适合需要提升自主学习能力的学生或开放书考试场景。

基于大语言模型的教育助手常直接给出答案,缺乏激励学生探索课程材料的动力。我们提出BLADE(Better Language Answers through Dialogue and Explanations),一种基于检索增强生成(RAG)的对话式助教,其依据课程特定内容,通过引用支撑的对话引导学生获取相关材料,而非提供无来源的答案。我们在一门高级本科自然语言处理课程中评估了BLADE,该课程拥有大量教学资源,定位与整合相关信息是核心挑战。在测验中,学生被分配至三种条件之一:仅使用BLADE、仅使用课程资料,或两者同时使用;我们测量了成绩与资源使用情况。结果表明,当两种资源都可用时,学生更倾向于选择BLADE;而仅使用BLADE时,测验表现最佳。相反,同时使用两者与显著更低的成绩相关,表明双模态结合可能引入认知负荷而无实际益处。研究显示,基于RAG的助教可作为开放书考试环境下应用课程内容的引用支撑接口,但提示添加直接资料访问未必有益,甚至可能损害任务表现。

原文摘要 · Abstract (English)

Large language model (LLM)-based educational assistants often provide direct answers offering little incentive for students to explore or engage with course materials. We present BLADE (Better Language Answers through Dialogue and Explanations), a retrieval-augmented generation (RAG) based conversational assistant grounded in course-specific content that guides students toward relevant materials through citation-grounded dialogue rather than delivering unsourced solutions. We evaluate BLADE in an advanced undergraduate NLP course with extensive instructional resources, where locating and synthesizing relevant material is a central challenge. During quizzes, students are assigned to one of three conditions: BLADE only, direct course materials only, or both; we measure performance and resource usage. Results show that students consistently select BLADE over direct materials when both are available, and that quiz performance is highest when students use BLADE alone. In contrast, simultaneous use of both resources is associated with significantly lower performance, suggesting that combining modalities may introduce cognitive load without benefit. These findings show the potential of RAG-based assistants as a citation-grounded interface for applying course content under open-book exam-like conditions, while cautioning that adding direct-material access does not necessarily help, and may hinder, in-task performance.

教育AIRAG对话系统学习效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。