arXiv:2509.01640cs.CLcs.LG2025-09被引 2

用Transformer+图网络实现作文多维度自动评分,效果优于传统方法。

TransGAT: Transformer-Based Graph Neural Networks for Multi-Dimensional Automated Essay Scoring

  • 结合细调Transformer与图注意力网络,捕捉上下文和句法关系。
  • 在ELLIPSE数据集上多维评分平均QWK达0.854,显著提升准确性。
  • 适合教育评估、智能批改系统研发人员参考。

作文写作是学生评估的关键环节,但人工评分耗时且不一致。自动作文评分(AES)提供了一种有前景的替代方案,但现有方法存在局限。近期研究虽将图神经网络(GNNs)引入AES,却使用静态词向量,难以捕捉多义词的上下文语义。此外,多数方法依赖整体评分,忽视语法、词汇、连贯性等具体维度。为此,本文提出TransGAT,一种融合微调Transformer与图注意力网络(GAT)的分析式评分新方法。TransGAT将BERT、RoBERTa和DeBERTaV3分别与独立GAT配对,形成双流预测:第一流生成文章级评分,第二流基于句法依存构建边,对Transformer token嵌入进行图注意力建模。最终融合双流输出得到分析评分。在ELLIPSE数据集上的实验表明,TransGAT在所有分析评分维度上平均达到0.854的加权肯德尔和谐系数(QWK),显著优于基线模型,验证了其在提升自动作文评分系统方面的潜力。

原文摘要 · Abstract (English)

Essay writing is a critical component of student assessment, yet manual scoring is labor-intensive and inconsistent. Automated Essay Scoring (AES) offers a promising alternative, but current approaches face limitations. Recent studies have incorporated Graph Neural Networks (GNNs) into AES using static word embeddings that fail to capture contextual meaning, especially for polysemous words. Additionally, many methods rely on holistic scoring, overlooking specific writing aspects such as grammar, vocabulary, and cohesion. To address these challenges, this study proposes TransGAT, a novel approach that integrates fine-tuned Transformer models with GNNs for analytic scoring. TransGAT combines the contextual understanding of Transformers with the relational modeling strength of Graph Attention Networks (GAT). It performs two-stream predictions by pairing each fine-tuned Transformer (BERT, RoBERTa, and DeBERTaV3) with a separate GAT. In each pair, the first stream generates essay-level predictions, while the second applies GAT to Transformer token embeddings, with edges constructed from syntactic dependencies. The model then fuses predictions from both streams to produce the final analytic score. Experiments on the ELLIPSE dataset show that TransGAT outperforms baseline models, achieving an average Quadratic Weighted Kappa (QWK) of 0.854 across all analytic scoring dimensions. These findings highlight the potential of TransGAT to advance AES systems.

自动评分图神经网络Transformer教育AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。