arXiv:2510.15756cs.CVcs.AI2025-10

用粗标注训练语义分割模型,提升边界对齐效果。

Semantic segmentation with coarse annotations

  • 引入基于SLIC超像素的正则化,约束解码后像素聚类。
  • 在粗标注下,边界召回率显著优于当前最优模型。
  • 适合标注成本高、边界精度要求高的场景。

语义分割旨在对图像中每个像素进行分类。使用精细标注(每像素标注类别)训练模型可获最佳性能。当精细标注难以获取时,可采用粗标注,例如仅大致标记像素,保留类别间边界的部分未标注区域。此类任务挑战在于优化类别边界的对齐。本文提出一种针对编码器-解码器结构的正则化方法,结合基于超像素的上采样策略,使解码输出的像素聚类符合SLIC超像素(基于像素颜色与位置,独立于标注)的结构。该方法应用于全卷积网络FCN-16,在SUIM、Cityscapes和PanNuke数据集上验证。结果表明,在粗标注条件下,边界召回率显著优于现有最优模型。

原文摘要 · Abstract (English)

Semantic segmentation is the task of classifying each pixel in an image. Training a segmentation model achieves best results using annotated images, where each pixel is annotated with the corresponding class. When obtaining fine annotations is difficult or expensive, it may be possible to acquire coarse annotations, e.g. by roughly annotating pixels in an images leaving some pixels around the boundaries between classes unlabeled. Segmentation with coarse annotations is difficult, in particular when the objective is to optimize the alignment of boundaries between classes. This paper proposes a regularization method for models with an encoder-decoder architecture with superpixel based upsampling. It encourages the segmented pixels in the decoded image to be SLIC-superpixels, which are based on pixel color and position, independent of the segmentation annotation. The method is applied to FCN-16 fully convolutional network architecture and evaluated on the SUIM, Cityscapes, and PanNuke data sets. It is shown that the boundary recall improves significantly compared to state-of-the-art models when trained on coarse annotations.

语义分割粗标注边界优化超像素

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。