arXiv:2604.21667cs.CLcs.AI2026-04中稿 · 5th NLPerspectives…

让机器理解标注者个人理由,提升模型对分歧的捕捉能力

Fine-Grained Perspectives: Modeling Explanations with Annotator-Specific Rationales

论文配图:Fine-Grained Perspectives: Modeling Explanations with Annotator-Specific Rationales
图 1 · 摘自论文原文
  • 用用户身份和背景信息建模标注者独特视角
  • 结合解释生成使预测更准确,提升语义一致性
  • 适合研究人类差异与模型可解释性的学者

除了对标注进行细粒度拆分以建模观点外,标注者的理由提供了个体观点的细粒度信号。本文提出一个联合建模标注者特定标签预测与对应解释的框架,基于标注者提供的理由进行微调。在包含细粒度自然语言推理(NLI)标注和标注者解释的数据集上,通过表示层的用户护照机制,将预测条件化于标注者身份与人口统计学元数据。我们引入两种解释器架构:后处理提示式解释器和前缀桥接解释器,后者将标注者条件化的分类器表示直接传递至生成模型。该设计使解释生成与个体标注者视角保持一致。结果表明,引入解释建模显著提升了基线标注者感知分类器的预测性能;前缀桥接方法实现更稳定的标签对齐与更高的语义一致性,而后处理方法产生更强的词汇相似性。这些发现表明,将解释视为细粒度观点的表达,能提供更丰富、更真实的分歧表征。所提方法通过将标注者特定理由整合到预测与生成组件中,推动了观点主义建模的发展。

原文摘要 · Abstract (English)

Beyond exploring disaggregated labels for modeling perspectives, annotator rationales provide fine-grained signals of individual perspectives. In this work, we propose a framework for jointly modeling annotator-specific label prediction and corresponding explanations, fine-tuned on the annotators' provided rationales. Using a dataset with disaggregated natural language inference (NLI) annotations and annotator-provided explanations, we condition predictions on both annotator identity and demographic metadata through a representation-level User Passport mechanism. We further introduce two explainer architectures: a post-hoc prompt-based explainer and a prefixed bridge explainer that transfers annotator-conditioned classifier representations directly into a generative model. This design enables explanation generation aligned with individual annotator perspectives. Our results show that incorporating explanation modeling substantially improves predictive performance over a baseline annotator-aware classifier, with the prefixed bridge approach achieving more stable label alignment and higher semantic consistency, while the post-hoc approach yields stronger lexical similarity. These findings indicate that modeling explanations as expressions of fine-grained perspective provides a richer and more faithful representation of disagreement. The proposed approaches advance perspectivist modeling by integrating annotator-specific rationales into both predictive and generative components.

可解释性标注者差异观点建模生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。