arXiv:2602.19130cs.LGcs.AI2026-02被引 1

用影响函数检测数据标注偏差,发现错误标签更易被识别。

Detecting labeling bias using influence functions

  • 通过梯度与海森矩阵估算样本影响,定位标注错误
  • 在MNIST上识别近90%错误标签,CheXpert中错误样本影响值更高
  • 适合关注数据质量、模型公平性的研究人员使用

标注偏差源于资源限制或无意识偏见,在数据收集过程中导致不同子群体的标签错误率不均或子群比例失真。现有公平性约束多假设训练标签反映真实分布,当存在标注偏差时失效,由此引出核心问题:如何检测此类偏差?本文探究影响函数在检测标注偏差中的应用。影响函数通过损失函数的梯度与海森矩阵,估算每个训练样本对模型预测的影响;当存在标注错误时,可识别训练集中错误标签样本,揭示潜在失效模式。我们构建样本价值评估流程,先在MNIST数据集测试,再扩展至更复杂的医学影像数据集CheXpert。为检验标签噪声,对某类20%标签进行人工翻转。采用对角海森近似,结果显示在MNIST上成功检测近90%误标样本;在CheXpert中,误标样本的影响力得分显著更高。结果表明,影响函数在识别标签错误方面具有潜力。

原文摘要 · Abstract (English)

Labeling bias arises during data collection due to resource limitations or unconscious bias, leading to unequal label error rates across subgroups or misrepresentation of subgroup prevalence. Most fairness constraints assume training labels reflect the true distribution, rendering them ineffective when labeling bias is present; leaving a challenging question, that \textit{how can we detect such labeling bias?} In this work, we investigate whether influence functions can be used to detect labeling bias. Influence functions estimate how much each training sample affects a model's predictions by leveraging the gradient and Hessian of the loss function -- when labeling errors occur, influence functions can identify wrongly labeled samples in the training set, revealing the underlying failure mode. We develop a sample valuation pipeline and test it first on the MNIST dataset, then scaled to the more complex CheXpert medical imaging dataset. To examine label noise, we introduced controlled errors by flipping 20\% of the labels for one class in the dataset. Using a diagonal Hessian approximation, we demonstrated promising results, successfully detecting nearly 90\% of mislabeled samples in MNIST. On CheXpert, mislabeled samples consistently exhibit higher influence scores. These results highlight the potential of influence functions for identifying label errors.

标注偏差影响函数数据质量医疗影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。