提出无需干净标签即可检测并缓解图像分割中的标签偏差方法。
Towards Fairness under Label Bias in Image Segmentation: Impact, Measurement and Mitigation

- 基于置信学习思想,通过模型自信预测与标注对比识别偏差方向。
- 在三个数据集上实现无清洁标签下的公平性能提升,消除群体间差异。
- 适用于真实场景中存在隐性偏见的视觉任务,尤其适合缺乏纯净标注的项目。
标注数据集反映了其标注流程中的偏见,有时会引入标签偏差:即与群体相关的标签错误,导致不同人口子群之间出现系统性性能差异。图像分割中的标签偏差仍鲜有研究,因为检测此类偏差通常需要干净、无偏的标注,而这类数据难以获取。本文提出一种面向分割任务的数据中心化置信学习方法,可在无干净标签的前提下直接从训练数据中检测标签偏差。通过比较训练标签与模型的置信预测,我们分离出具有方向性的错误,从而量化偏差的存在与性质,而传统重叠指标(如Dice)无法做到。进一步发现,标签偏差会影响编码器特征空间中子群的可分性,我们利用这一现象进行偏差缓解而非压制。在三个涵盖从合成到真实偏见的数据集上评估,验证了该框架在无清洁标签条件下可靠检测并缓解偏差的能力,实现了跨实验条件的均衡表现。
原文摘要 · Abstract (English)
Labeled datasets reflect the biases of their annotation pipelines, which sometimes introduce label bias: group-conditional label errors that cause systematic performance disparities across demographic subgroups. Label bias in image segmentation remains underexplored, as even detecting it typically requires clean, unbiased annotations, which are not readily available. We present a data-centric adaptation of Confident Learning to segmentation, allowing detection of label bias directly in the training data without a clean, unbiased ground truth. By comparing the provided training labels to the model's confident predictions, we isolate directional errors that quantify the presence and nature of bias, where standard overlap metrics like Dice fail. We further show that label bias influences subgroup separability in the encoder's feature space, an artifact we leverage for bias mitigation rather than suppressing it. We evaluate three datasets, spanning from synthetic to real-life bias, showing how our framework reliably detects and mitigates bias without access to clean labels, achieving equitable performance across experimental conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。