arXiv:2504.14795eess.IVcs.CV2025-04

考虑标签错误的空间相关性,提升含噪标注下的语义分割精度。

A Bayesian Approach to Segmentation with Noisy Labels via Spatially Correlated Distributions

  • 用空间相关分布建模标签错误,假设相邻像素错误更可能一致。
  • 提出可计算变分下界的新模型(ECCD),解决高维离散变量推理难题。
  • 在肺部分割等任务中,噪声下性能接近干净数据训练效果。

在语义分割中,模型精度高度依赖高质量标注。但在医学影像和遥感等实际场景中,获取真实标注需大量人力,常引入误标、漏标及标注者间不一致等问题。遥感中因采集时间差异还会导致真值标注错位。这些标签错误并非独立分布,而是呈现空间聚集性,相邻像素更可能共享相同错误。为此,本文提出一种基于概率模型的近似贝叶斯估计方法,显式建模标签错误的空间相关性。然而,对具有空间相关性的离散变量进行贝叶斯推断极为困难。为此,我们引入一类新型概率模型——可计算变分下界的相关离散分布(ECCD),通过连续潜变量高斯场与Kac-Murdock-Szegö(KMS)结构协方差表示离散依赖关系,实现此前计算上不可行问题的高效可扩展变分推断。在多个分割任务上的实验表明,利用标签错误的空间相关性显著提升性能。尤其在肺部分割任务中,该方法在中等噪声水平下表现接近使用干净标签训练的结果。代码已开源。

原文摘要 · Abstract (English)

In semantic segmentation, the accuracy of models heavily depends on the high-quality annotations. However, in many practical scenarios, such as medical imaging and remote sensing, obtaining true annotations is not straightforward and usually requires significant human labor. Relying on human labor often introduces annotation errors, including mislabeling, omissions, and inconsistency between annotators. In the case of remote sensing, differences in procurement time can lead to misaligned ground-truth annotations. These label errors are not independently distributed, and instead usually appear in spatially connected regions where adjacent pixels are more likely to share the same errors. To address these issues, we propose an approximate Bayesian estimation based on a probabilistic model that assumes training data include label errors, incorporating the tendency for these errors to occur with spatial correlations between adjacent pixels. However, Bayesian inference for such spatially correlated discrete variables is notoriously intractable. To overcome this fundamental challenge, we introduce a novel class of probabilistic models, which we term the ELBO-Computable Correlated Discrete Distribution (ECCD). By representing the discrete dependencies through a continuous latent Gaussian field with a Kac-Murdock-Szegö (KMS) structured covariance, our framework enables scalable and efficient variational inference for problems previously considered computationally prohibitive. Through experiments on multiple segmentation tasks, we confirm that leveraging the spatial correlation of label errors significantly improves performance. Notably, in specific tasks such as lung segmentation, the proposed method achieves performance comparable to training with clean labels under moderate noise levels. Code is available at https://github.com/pfnet-research/Bayesian_SpatialCorr.

语义分割贝叶斯方法标签噪声空间相关

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。