arXiv:2512.23035cs.CV2025-12被引 1

用双模型协同引导,解决遥感图像分割中伪标签漂移问题。

Toward Stable Semi-Supervised Remote Sensing Segmentation via Co-Guidance and Co-Fusion

  • 构建双视觉学生架构,分别基于CLIP和DINOv3预训练模型。
  • 在六大数据集上均超越现有方法,提升分割精度与稳定性。
  • 适合遥感图像语义分割任务,尤其适用于标注数据稀缺场景。

半监督遥感图像语义分割可缓解海量标注负担,但易受伪标签漂移影响,导致错误累积。本文提出Co2S框架,通过融合视觉-语言模型与自监督模型的先验知识,构建由CLIP和DINOv3初始化的异构双学生视觉变压器架构,以抑制误差传播。引入显式-隐式语义协同引导机制,分别利用文本嵌入与可学习查询提供类级显式与隐式指导,增强语义一致性。同时设计全局-局部特征协同融合策略,有效结合CLIP的全局上下文与DINOv3的局部细节,实现高精度分割。在六个主流数据集上的实验表明,该方法在多种划分协议与复杂场景下均保持领先性能。

原文摘要 · Abstract (English)

Semi-supervised remote sensing (RS) image semantic segmentation offers a promising solution to alleviate the burden of exhaustive annotation, yet it fundamentally struggles with pseudo-label drift, a phenomenon where confirmation bias leads to the accumulation of errors during training. In this work, we propose Co2S, a stable semi-supervised RS segmentation framework that synergistically fuses priors from vision-language models and self-supervised models. Specifically, we construct a heterogeneous dual-student architecture comprising two distinct ViT-based vision foundation models initialized with pretrained CLIP and DINOv3 to mitigate error accumulation and pseudo-label drift. To effectively incorporate these distinct priors, an explicit-implicit semantic co-guidance mechanism is introduced that utilizes text embeddings and learnable queries to provide explicit and implicit class-level guidance, respectively, thereby jointly enhancing semantic consistency. Furthermore, a global-local feature collaborative fusion strategy is developed to effectively fuse the global contextual information captured by CLIP with the local details produced by DINOv3, enabling the model to generate highly precise segmentation results. Extensive experiments on six popular datasets demonstrate the superiority of the proposed method, which consistently achieves leading performance across various partition protocols and diverse scenarios. Project page is available at https://xavierjiezou.github.io/Co2S/.

遥感分割半监督双模型伪标签

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。