通过仅对标签施加弹性形变,提升分割模型对隐式标签噪声的鲁棒性。
Unlocking Robust Semantic Segmentation Performance via Label-only Elastic Deformations against Implicit Label Noise
- 分离图像与标签的增强方式,只对标签做弹性形变
- 在多个数据集上实现最高3.39的mIoU提升
- 特别适合处理真实场景中细微但普遍存在的标注偏差
现有图像分割研究多关注严重(显式)标签噪声,但现实数据集还存在隐含的微小标注缺陷,如边界模糊和标注者差异。这类潜在噪声虽不明显,却会损害模型性能。传统数据增强方法对图像和标签同步变换,可能放大此类细微误差,限制模型泛化能力。本文提出NSegment+,一种新型增强框架,将图像与标签变换解耦:仅对分割标签施加受控的弹性形变,保留原始图像。该方法促使模型聚焦于学习稳健的对象结构表征,即使面对轻微标签不一致。大量实验表明,NSegment+在Vaihingen、LoveDA、Cityscapes和PASCAL VOC上分别获得最高2.29、2.38、1.75和3.39的平均mIoU提升,且无需复杂技巧;结合CutMix和标签平滑等训练策略后,性能还可进一步增强。
原文摘要 · Abstract (English)
While previous studies on image segmentation focus on handling severe (or explicit) label noise, real-world datasets also exhibit subtle (or implicit) label imperfections. These arise from inherent challenges, such as ambiguous object boundaries and annotator variability. Although not explicitly present, such mild and latent noise can still impair model performance. Typical data augmentation methods, which apply identical transformations to the image and its label, risk amplifying these subtle imperfections and limiting the model's generalization capacity. In this paper, we introduce NSegment+, a novel augmentation framework that decouples image and label transformations to address such realistic noise for semantic segmentation. By introducing controlled elastic deformations only to segmentation labels while preserving the original images, our method encourages models to focus on learning robust representations of object structures despite minor label inconsistencies. Extensive experiments demonstrate that NSegment+ consistently improves performance, achieving mIoU gains of up to +2.29, +2.38, +1.75, and +3.39 in average on Vaihingen, LoveDA, Cityscapes, and PASCAL VOC, respectively-even without bells and whistles, highlighting the importance of addressing implicit label noise. These gains can be further amplified when combined with other training tricks, including CutMix and Label Smoothing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。