arXiv:2411.17593cs.CLcs.AI2024-11被引 1

用AI自动评估英文文学文本难度,助力教学内容精准匹配课程标准。

What Differentiates Educational Literature? A Multimodal Fusion Approach of Transformers and Computational Linguistics

  • 融合Transformer与语言学特征分析,多模态判断文本复杂度。
  • 最优模型融合后F1达0.996,显著优于单一模型(最高0.75)。
  • 开发网页工具,让教师实时获取文本适配建议,减少备课负担。

将新文献纳入英语课程仍面临挑战,因教育者缺乏可扩展的工具来快速评估可读性并适应不同课堂需求。本研究提出一种多模态方法,结合基于Transformer的文本分类与语言学特征分析,使文本与英国关键阶段(UK Key Stages)对齐。八种先进Transformer在分段文本数据上微调,BERT实现最高单模态F1分数0.75。同时,搜索500种深度神经网络拓扑以分类语言特征,取得F1分数0.392。多模态融合显著提升性能,所有融合模型均优于单一模型;其中ELECTRA与神经网络融合模型达到F1 0.996。单模态与多模态在准确率、精确率、召回率和F1分数上均有统计显著差异,仅推理时间无显著差异。最终,该方法封装为面向利益相关者的网页应用,提供文本复杂度、阅读难度、课程契合度及学习年龄推荐等实时洞察,支持数据驱动决策,通过集成AI建议降低教案编制的人工工作量。

原文摘要 · Abstract (English)

The integration of new literature into the English curriculum remains a challenge since educators often lack scalable tools to rapidly evaluate readability and adapt texts for diverse classroom needs. This study proposes to address this gap through a multimodal approach that combines transformer-based text classification with linguistic feature analysis to align texts with UK Key Stages. Eight state-of-the-art Transformers were fine-tuned on segmented text data, with BERT achieving the highest unimodal F1 score of 0.75. In parallel, 500 deep neural network topologies were searched for the classification of linguistic characteristics, achieving an F1 score of 0.392. The fusion of these modalities shows a significant improvement, with every multimodal approach outperforming all unimodal models. In particular, the ELECTRA Transformer fused with the neural network achieved an F1 score of 0.996. Unimodal and multimodal approaches are shown to have statistically significant differences in all validation metrics (accuracy, precision, recall, F1 score) except for inference time. The proposed approach is finally encapsulated in a stakeholder-facing web application, providing non-technical stakeholder access to real-time insights on text complexity, reading difficulty, curriculum alignment, and recommendations for learning age range. The application empowers data-driven decision making and reduces manual workload by integrating AI-based recommendations into lesson planning for English literature.

教育AI文本分析多模态课程匹配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。