arXiv:2605.10415cs.CL2026-05被引 1

让大模型学会表达不确定,更贴近人类对主观问题的分歧程度。

Aligning LLM Uncertainty with Human Disagreement in Subjectivity Analysis

论文配图:Aligning LLM Uncertainty with Human Disagreement in Subjectivity Analysis
图 1 · 摘自论文原文
  • 分两阶段建模:先感知意见分歧,再对齐模型自信度与人类不一致分布。
  • 在3个主观任务上,边界样本过自信现象减少,跨数据集泛化能力提升。
  • 适合关注模型可靠性、可解释性的研究人员,尤其对主观判断场景有用。

用于主观性分析的大语言模型通常采用聚合标签进行训练,将人类判断差异压缩为单一监督信号。这种范式忽略了低一致样本的内在不确定性,常导致模型过度自信,削弱了复杂主观场景下的可靠性与泛化能力。本文倡导一种考虑不确定性的主观性分析方法,要求模型在预测时能表达反映人类分歧程度的不确定性。为此,提出两阶段的分歧感知与不确定性对齐(DPUA)框架。DPUA联合建模标签预测、理由生成与不确定性表达,在分歧感知阶段通过自适应解耦学习增强模型对分歧线索的敏感性,同时保持任务性能;在不确定性对齐阶段,基于GRPO的奖励优化进一步提升不确定性推理能力,并使模型置信度与人类分歧分布对齐。在三个主观性分析任务上的实验表明,DPUA在保持任务性能的同时,更好对齐模型不确定性与人类分歧,缓解边界样本的过自信问题,提升分布外泛化能力。

原文摘要 · Abstract (English)

Large language models for subjectivity analysis are typically trained with aggregated labels, which compress variations in human judgment into a single supervision signal. This paradigm overlooks the intrinsic uncertainty of low-agreement samples and often induces overconfident predictions, undermining reliability and generalization in complex subjective settings. In this work, we advocate uncertainty-aware subjectivity analysis, where models are expected to make predictions while expressing uncertainty that reflects human disagreement. To operationalize this perspective, we propose a two-phase Disagreement Perception and Uncertainty Alignment (DPUA) framework. Specifically, DPUA jointly models label prediction, rationale generation, and uncertainty expression under an uncertainty-aware setting. In the disagreement perception phase, adaptive decoupled learning enhances the model's sensitivity to disagreement-related cues while preserving task performance. In the uncertainty alignment phase, GRPO-based reward optimization further improves uncertainty-aware reasoning and aligns the model's confidence expression with the human disagreement distribution. Experiments on three subjectivity analysis tasks show that DPUA preserves task performance while better aligning model uncertainty with human disagreement, mitigating overconfidence on boundary samples, and improving out-of-distribution generalization.

大模型不确定性主观分析可信推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。