arXiv:2606.12186cs.CL2026-06

构建政治争议言论中隐含推理的标注资源,助力理解人类推断差异。

A Resource for Enthymeme Detection in Controversial Political Discourse

论文配图:A Resource for Enthymeme Detection in Controversial Political Discourse
图 1 · 摘自论文原文
  • 基于沃尔顿论证模式制定结构化标注指南,保留解释空间。
  • 发现标注者分歧多发于高认知负荷环节,影响一致性。
  • 利用标注差异训练模型,性能优于传统多数投票法。

本文构建了一个包含1,482条政治争议性推文的标注数据集,由五名标注者共同标注隐含推理(enthymemes)及其论证结构,旨在研究标签变异问题。我们重新审视了隐含推理的定义,提出基于沃尔顿论证模式的标注指南,提供结构化但留有解释余地的方法,不同于以往消除分歧的资源设计,避免掩盖分歧根源并阻碍对分歧潜在益处的研究。通过任务复杂性分析,识别出高认知负荷环节易引发标注不一致。初步实验表明,使用标注者分歧信息训练的模型,在性能上优于仅用多数投票标签训练的模型。最后,我们强调隐含推理定义与指南的结构性开放性,为未来研究人类推断过程变异及下游自然语言处理应用提供可能。

原文摘要 · Abstract (English)

Enthymemes, arguments with unstated premises or conclusions, are pervasive in persuasive discourse, yet their annotation remains notoriously subjective. We present a resource of 1,482 tweets from politically controversial discourse, annotated by five annotators for the presence of enthymemes and their argument structure, designed to study label variation. We first revisit the definition of enthymemes and propose annotation guidelines anchored in Walton's argumentation schemes, offering a structured and constrained approach that nonetheless preserves room for the interpretive nature of the task. This contrasts with past resources, which tend to eliminate disagreement, obscuring its sources and preventing investigation of its potential benefits for model performance. We further propose a complexity analysis of the task, identifying where annotation imposes high cognitive load and may give rise to inconsistent annotation. Our preliminary experiments show that models trained on annotator disagreement outperform models trained on hard majority-vote labels. We close by reflecting on how structural openness in enthymeme definitions and guidelines enables the study of variation in subjective inferential processes for future resources and downstream NLP applications concerned with human inference.

隐含推理主观标注政治话语标注差异

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。