arXiv:2604.07198cs.LGcs.ET2026-04中稿 · CVPR被引 1

用分布建模情感标注差异,提升主观信号分析精度

Beyond the Mean: Modelling Annotation Distributions in Continuous Affect Prediction

  • 采用贝塔分布建模多个标注者的分布特征,捕捉情绪感知的不确定性
  • 在SEWA和RECOLA数据集上预测分布与真实标注分布高度吻合
  • 适合研究情感计算中主观性、标注不确定性的学者和工程师

情感标注本质上具有主观性且认知负担重,导致不同标注者产生多样化的感知信号,而非单一真实值。在连续情感预测中,这种差异通常被简化为均值或中位数等点估计,损失了标注者分歧与不确定性的信息。本文提出一种分布感知框架,利用贝塔分布建模标注共识。模型不再预测单一情感值,而是估计标注分布的均值与标准差,并通过矩匹配转换为有效的贝塔分布参数。该形式可闭式恢复偏度、峰度和分位数等高阶分布特征。结果表明,该方法不仅能捕捉情绪感知的中心趋势,还能表征标注者的变异、不对称性和不确定性。在包含多模态特征的SEWA与RECOLA数据集上进行评估,基于贝塔分布的建模生成的预测分布与实际标注分布高度一致,性能媲美传统回归方法。研究强调了在情感计算中建模标注不确定性的必要性,并展示了分布感知学习在主观信号分析中的潜力。

原文摘要 · Abstract (English)

Emotion annotation is inherently subjective and cognitively demanding, producing signals that reflect diverse perceptions across annotators rather than a single ground truth. In continuous affect prediction, this variability is typically collapsed into point estimates such as the mean or median, discarding valuable information about annotator disagreement and uncertainty. In this work, we propose a distribution-aware framework that models annotation consensus using the Beta distribution. Instead of predicting a single affect value, models estimate the mean and standard deviation of the annotation distribution, which are transformed into valid Beta parameters through moment matching. This formulation enables the recovery of higher-order distributional descriptors, including skewness, kurtosis, and quantiles, in closed form. As a result, the model captures not only the central tendency of emotional perception but also variability, asymmetry, and uncertainty in annotator responses. We evaluate the proposed approach on the SEWA and RECOLA datasets using multimodal features. Experimental results show that Beta-based modelling produces predictive distributions that closely match the empirical annotator distributions while achieving competitive performance with conventional regression approaches. These findings highlight the importance of modelling annotation uncertainty in affective computing and demonstrate the potential of distribution-aware learning for subjective signal analysis.

情感计算分布建模主观性分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。