arXiv:2508.03520cs.CLcs.LG2025-08被引 1

让模型自己判断情感评分的可信度,提升噪声数据下的预测稳定性。

UPLME: Uncertainty-Aware Probabilistic Language Modelling for Robust Empathy Regression

  • 用概率语言模型同时预测情感分和不确定性,结合贝叶斯集成训练。
  • 在两个有噪声的数据集上相关系数提升至0.580和0.634,优于现有方法。
  • 能识别出哪些评分是噪音,适合处理不靠谱的人工标注数据。

自报的情感评分存在噪声,给情感回归的监督学习带来挑战。尽管文本分类中已有大量处理噪声标签的方法,但回归任务仍研究不足。本文提出UPLME——一种不确定性感知的概率语言建模框架,用于捕捉情感回归中的标签噪声。UPLME采用概率语言模型,同时预测情感得分与异方差不确定性,并基于变分模型集成与贝叶斯思想进行训练。引入两种新损失:一是惩罚不确定量化退化,二是强制要求相似输入对的情感预测保持一致。在两个含噪声的公开基准上,UPLME实现最优性能(皮尔逊相关系数从0.558→0.580,0.629→0.634)。通过人工注入噪声,验证其能根据预测不确定性有效区分噪声与干净样本。相比近期基于变分集成的回归不确定性量化方法,其校准误差由0.571降至0.376。代码已开源于https://github.com/hasan-rakibul/UPLME。

原文摘要 · Abstract (English)

Noisy self-reported empathy scores challenge supervised learning for empathy regression. While many algorithms have been proposed for learning with noisy labels in textual classification problems, the regression counterpart is relatively under-explored. We propose UPLME, an uncertainty-aware probabilistic language modelling framework to capture label noise in empathy regression tasks. One of the novelties in UPLME is a probabilistic language model that predicts both empathy scores and heteroscedastic uncertainty, and is trained using Bayesian concepts with variational model ensembling. We further introduce two novel loss components: one penalises degenerate Uncertainty Quantification (UQ), and another enforces similarity between the input pairs on which empathy is being predicted. UPLME achieves state-of-the-art performance (Pearson Correlation Coefficient: $0.558\rightarrow0.580$ and $0.629\rightarrow0.634$) in terms of the performance reported in the literature on two public benchmarks with label noise. Through synthetic label noise injection, we demonstrate that UPLME is effective in distinguishing between noisy and clean samples based on the predicted uncertainty. UPLME further outperform (Calibration error: $0.571\rightarrow0.376$) a recent variational model ensembling-based UQ method designed for regression problems. Code is publicly available at https://github.com/hasan-rakibul/UPLME.

情感分析不确定性量化噪声标签概率建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。