arXiv:2603.14891cs.CLcs.AI2026-03

让大模型直接输出评分,更准更可解释。

Decision-Level Ordinal Modeling for Multimodal Essay Scoring with Large Language Models

  • 把评分当作显式序数决策,用预定义分数标记提取得分逻辑。
  • 在多模态数据上提升1.2%~2.8%的评分准确率,尤其对视觉信息不稳定的作文效果更好。
  • 适合需要高可解释性评分的教育评估场景,如智能阅卷系统。

自动作文评分(AES)需为每篇作文预测多个按等级划分的评分维度。现有基于大语言模型的方法将评分视为自回归生成任务,通过解码和解析获取最终分数,导致决策过程隐式且敏感。针对多模态场景中视觉信息有效性因文而异的问题,本文提出决策级序数建模(DLOM),通过复用语言模型头部提取预设分数标记的得分逻辑,实现评分空间中的直接优化与分析。对于多模态场景,DLOM-GF引入门控融合模块,自适应整合文本与多模态得分逻辑;对于纯文本场景,DLOM-DA加入距离感知正则项以更好反映序数间距。在多模态EssayJudge数据集上的实验表明,DLOM优于生成基基线,在不同模态相关性下均有提升;在纯文本ASAP/ASAP++基准上,DLOM仍有效,DLOM-DA进一步超越主流基线。

原文摘要 · Abstract (English)

Automated essay scoring (AES) predicts multiple rubric-defined trait scores for each essay, where each trait follows an ordered discrete rating scale. Most LLM-based AES methods cast scoring as autoregressive token generation and obtain the final score via decoding and parsing, making the decision implicit. This formulation is particularly sensitive in multimodal AES, where the usefulness of visual inputs varies across essays and traits. To address these limitations, we propose Decision-Level Ordinal Modeling (DLOM), which makes scoring an explicit ordinal decision by reusing the language model head to extract score-wise logits on predefined score tokens, enabling direct optimization and analysis in the score space. For multimodal AES, DLOM-GF introduces a gated fusion module that adaptively combines textual and multimodal score logits. For text-only AES, DLOM-DA adds a distance-aware regularization term to better reflect ordinal distances. Experiments on the multimodal EssayJudge dataset show that DLOM improves over a generation-based SFT baseline across scoring traits, and DLOM-GF yields further gains when modality relevance is heterogeneous. On the text-only ASAP/ASAP++ benchmarks, DLOM remains effective without visual inputs, and DLOM-DA further improves performance and outperforms strong representative baselines.

自动评分大模型多模态序数建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。