arXiv:2508.05987cs.CL2025-08被引 1

通过对抗性提示调优,同时捕捉共通与特定话题特征,提升跨话题作文评分效果。

Adversarial Topic-aware Prompt-tuning for Cross-topic Automated Essay Scoring

  • 设计可学习的话题感知提示,融合共享与特定成分,从预训练模型中激发相关知识。
  • 在ASAP++数据集上,整体评分和多维度评分均显著优于现有方法。
  • 适合需要跨话题、高精度作文自动评分的教育AI研究者或系统开发者。

跨话题自动作文评分(AES)旨在构建一个可迁移的模型,有效评估目标话题的作文。该领域的主要挑战源于不同话题间的固有差异。现有方法主要通过源话题与目标话题的分布对齐来提取共通特征,但往往忽略话题特定特征,限制了对话题契合度等关键特质的评估能力。为此,我们提出对抗性话题感知提示调优(ATOP),一种联合学习话题共享与特定特征的新方法。ATOP通过优化一个可学习的话题感知提示(包含共享与特定组件),从预训练语言模型(PLMs)中激发相关知识。为增强话题共享提示学习的鲁棒性并缓解话题对齐带来的特征尺度敏感问题,我们在统一的回归与分类框架中引入对抗训练。此外,采用基于邻域的分类器建模作文表示的局部结构,并生成目标话题作文的伪标签,用于指导针对目标话题定制的话题特定提示的监督学习。在公开的ASAP++数据集上的大量实验表明,ATOP在整体评分和多维度评分上均显著优于现有最先进方法。代码已公开:https://anonymous.4open.science/r/ATOP-A271。

原文摘要 · Abstract (English)

Cross-topic automated essay scoring (AES) aims to develop a transferable model capable of effectively evaluating essays on a target topic. A significant challenge in this domain arises from the inherent discrepancies between topics. While existing methods predominantly focus on extracting topic-shared features through distribution alignment of source and target topics, they often neglect topic-specific features, limiting their ability to assess critical traits such as topic adherence. To address this limitation, we propose an Adversarial TOpic-aware Prompt-tuning (ATOP), a novel method that jointly learns topic-shared and topic-specific features to improve cross-topic AES. ATOP achieves this by optimizing a learnable topic-aware prompt--comprising both shared and specific components--to elicit relevant knowledge from pre-trained language models (PLMs). To enhance the robustness of topic-shared prompt learning and mitigate feature scale sensitivity introduced by topic alignment, we incorporate adversarial training within a unified regression and classification framework. In addition, we employ a neighbor-based classifier to model the local structure of essay representations and generate pseudo-labels for target-topic essays. These pseudo-labels are then used to guide the supervised learning of topic-specific prompts tailored to the target topic. Extensive experiments on the publicly available ASAP++ dataset demonstrate that ATOP significantly outperforms existing state-of-the-art methods in both holistic and multi-trait essay scoring. The implementation of our method is publicly available at: https://anonymous.4open.science/r/ATOP-A271.

自动评分提示调优跨话题教育AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。