通过学习多尺度结构复杂度,提升自监督分割精度
MSSSeg: Learning Multi-Scale Structural Complexity for Self-Supervised Segmentation
- 引入可微盒计数模块,捕捉跨尺度结构特征
- 在多个数据集上达到新最好性能,尤其改善边界混淆问题
- 适合关注结构感知与自监督分割的研究者
自监督语义分割方法常因依赖颜色、纹理等低层外观线索而产生结构错误,如合并不同物体或分裂连贯区域。这些线索缺乏结构判别力,无法反映区域的组织结构。现有方法虽引入深度先验,但未显式建模外观模糊时仍存在的结构复杂性。为此,本文提出MSSSeg框架,从语义和深度域显式学习多尺度结构复杂性,包含三个组件:(1) 可微盒计数(DBC)模块,对齐多尺度结构特征与语义特征;(2) 可学习结构增强(StructAug),破坏像素强度模式,迫使网络依赖DBC提供的结构特征;(3) 持久同调损失(PHLoss),直接监督预测分割的结构复杂性。大量实验表明,MSSSeg在COCO-Stuff-27、Cityscapes和Potsdam数据集上达到新最优性能,且计算开销可控,验证了显式学习结构复杂性的关键作用。
原文摘要 · Abstract (English)
Self-supervised semantic segmentation methods often suffer from structural errors, including merging distinct objects or fragmenting coherent regions, because they rely primarily on low-level appearance cues such as color and texture. These cues lack structural discriminability: they carry no information about the structural organization of a region, making it difficult to distinguish boundaries between similar-looking objects or maintain coherence within internally varying regions. Recent approaches attempt to address this by incorporating depth priors, yet remain limited by not explicitly modeling structural complexity that persists even when appearance cues are ambiguous. To bridge this gap, we present MSSSeg, a framework that explicitly learns multi-scale structural complexity from both semantic and depth domains, via three coupled components: (1) a Differentiable Box-Counting (DBC) module that captures and aligns multi-scale structural complexity features with semantic features; (2) a Learnable Structural Augmentation (StructAug) that corrupts pixel-intensity patterns, forcing the network to rely on structural complexity features from DBC; and (3) a Persistent Homology Loss (PHLoss) that directly supervises the structural complexity of predicted segmentations. Extensive experiments demonstrate that MSSSeg achieves new state-of-the-art performance on COCO-Stuff-27, Cityscapes, and Potsdam without excessive computational overhead, validating that explicit structural complexity learning is crucial for self-supervised segmentation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。