arXiv:2604.07021cs.CV2026-04中稿 · ECCV

不训练即可精准分割,通过分离发现与语义匹配提升边界质量

ModuSeg: Decoupling Object Discovery and Semantic Retrieval for Training-Free Weakly Supervised Segmentation

论文配图:ModuSeg: Decoupling Object Discovery and Semantic Retrieval for Training-Free Weakly Supervised Segmentation
图 1 · 摘自论文原文
  • 拆分物体发现与语义匹配,避免模型只关注显著区域
  • 利用基础模型构建离线特征库,实现无需微调的像素级定位
  • 适合追求高效、高精度弱监督分割的研究者和应用开发

弱监督语义分割旨在仅使用图像级标签实现像素级预测。现有方法通常将语义识别与目标定位紧密耦合,导致模型过度关注稀疏判别区域。尽管基础模型潜力巨大,但多数方法仍沿用紧耦合优化范式,在缓解伪标签噪声方面表现不佳,常依赖耗时的多阶段重训练或不稳定的端到端联合优化。为此,我们提出 ModuSeg,一种以显式解耦物体发现与语义分配为核心的无训练弱监督分割框架。具体而言,我们集成通用掩码生成器提取具有可靠边界的几何提议,同时利用语义基础模型构建离线特征库,将分割转化为非参数化的特征检索过程。此外,我们提出语义边界净化与软掩码特征聚合策略,有效缓解边界模糊与量化误差,从而提取高质量类别原型。大量实验表明,所提出的解耦架构在无需参数微调的情况下,仍能更好保留精细边界,并在标准基准数据集上取得极具竞争力的性能。代码已开源:https://github.com/Autumnair007/ModuSeg。

原文摘要 · Abstract (English)

Weakly supervised semantic segmentation aims to achieve pixel-level predictions using image-level labels. Existing methods typically entangle semantic recognition and object localization, which often leads models to focus exclusively on sparse discriminative regions. Although foundation models show immense potential, many approaches still follow the tightly coupled optimization paradigm, struggling to effectively alleviate pseudo-label noise and often relying on time-consuming multi-stage retraining or unstable end-to-end joint optimization. To address the above challenges, we present ModuSeg, a training-free weakly supervised semantic segmentation framework centered on explicitly decoupling object discovery and semantic assignment. Specifically, we integrate a general mask proposer to extract geometric proposals with reliable boundaries, while leveraging semantic foundation models to construct an offline feature bank, transforming segmentation into a non-parametric feature retrieval process. Furthermore, we propose semantic boundary purification and soft-masked feature aggregation strategies to effectively mitigate boundary ambiguity and quantization errors, thereby extracting high-quality category prototypes. Extensive experiments demonstrate that the proposed decoupled architecture better preserves fine boundaries without parameter fine-tuning and achieves highly competitive performance on standard benchmark datasets. Code is available at https://github.com/Autumnair007/ModuSeg.

弱监督分割无训练特征检索边界优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。