用大模型从真实课堂视频中选上下文并重写,生成精准匹配答案的问题。
Context Selection and Rewriting for Video-based Educational Question Generation
- 基于答案相关性和时间临近性,从语音转录和视频帧中动态选上下文。
- 重写上下文为含答案的知识陈述,提升问题与答案的逻辑关联。
- 适合作为教育AI研究者或智能题库开发者参考,尤其关注真实场景数据。
教育问答生成(EQG)是智能教育系统的关键组成部分,有助于自我评估、主动学习和个性化教学。现有数据集多依赖预设编辑好的文本,难以反映真实课堂内容,如包含配套幻灯片的讲座语音。为此,我们收集了基于真实课堂讲座的教育问答数据集。在该真实数据集上发现,当前方法在从教育视频生成问题时,难以准确对齐特定时间戳和目标答案。主要挑战包括从长篇转录文本中筛选有效上下文,以及确保生成问题有意义地融入目标答案。为此,我们提出一种新框架,利用大语言模型根据目标时间戳和答案动态选择并重写上下文。首先,从讲座转录文本和视频关键帧中基于答案相关性和时间临近性选择上下文;然后,融合双模态上下文并重写为含答案的知识陈述,增强上下文与目标答案的逻辑联系。该方法显著提升了生成问题的质量和相关性。数据集与代码已开源:https://github.com/mengxiayu/COSER。
原文摘要 · Abstract (English)
Educational question generation (EQG) is a crucial component of intelligent educational systems, significantly aiding self-assessment, active learning, and personalized education. While EQG systems have emerged, existing datasets typically rely on predefined, carefully edited texts, failing to represent real-world classroom content, including lecture speech with a set of complementary slides. To bridge this gap, we collect a dataset of educational questions based on lectures from real-world classrooms. On this realistic dataset, we find that current methods for EQG struggle with accurately generating questions from educational videos, particularly in aligning with specific timestamps and target answers. Common challenges include selecting informative contexts from extensive transcripts and ensuring generated questions meaningfully incorporate the target answer. To address the challenges, we introduce a novel framework utilizing large language models for dynamically selecting and rewriting contexts based on target timestamps and answers. First, our framework selects contexts from both lecture transcripts and video keyframes based on answer relevance and temporal proximity. Then, we integrate the contexts selected from both modalities and rewrite them into answer-containing knowledge statements, to enhance the logical connection between the contexts and the desired answer. This approach significantly improves the quality and relevance of the generated questions. Our dataset and code are released in https://github.com/mengxiayu/COSER.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。