arXiv:2507.12857cs.CV2025-07ICCV被引 11

提出融合场景上下文的开放词汇遥感实例分割框架,提升新类别识别能力。

SCORE: Scene Context Matters in Open-Vocabulary Remote Sensing Instance Segmentation

  • 引入区域与全局场景上下文,增强视觉与文本表征
  • 在多个遥感数据集上达到当前最优性能
  • 适合需要跨域泛化和新类别识别的地理空间分析场景

现有遥感实例分割方法多针对封闭词汇设计,难以识别新类别或跨数据集泛化,限制了其在多样化地球观测场景中的应用。为此,本文提出面向遥感开放词汇实例分割的SCORE框架,通过整合多粒度场景上下文(区域与全局)来增强视觉与文本表征。具体地,提出区域感知融合机制,利用区域上下文优化类别嵌入以提升对象可区分性;同时设计全局上下文自适应模块,将遥感全局上下文融入文本嵌入,构建更灵活、丰富的语义潜在空间。我们在多个遥感数据集上建立了新的开放词汇分割基准。实验表明,所提方法在多种场景下均取得当前最优性能,为大规模真实地理空间分析提供了稳健解决方案。

原文摘要 · Abstract (English)

Most existing remote sensing instance segmentation approaches are designed for close-vocabulary prediction, limiting their ability to recognize novel categories or generalize across datasets. This restricts their applicability in diverse Earth observation scenarios. To address this, we introduce open-vocabulary (OV) learning for remote sensing instance segmentation. While current OV segmentation models perform well on natural image datasets, their direct application to remote sensing faces challenges such as diverse landscapes, seasonal variations, and the presence of small or ambiguous objects in aerial imagery. To overcome these challenges, we propose $\textbf{SCORE}$ ($\textbf{S}$cene $\textbf{C}$ontext matters in $\textbf{O}$pen-vocabulary $\textbf{RE}$mote sensing instance segmentation), a framework that integrates multi-granularity scene context, i.e., regional context and global context, to enhance both visual and textual representations. Specifically, we introduce Region-Aware Integration, which refines class embeddings with regional context to improve object distinguishability. Additionally, we propose Global Context Adaptation, which enriches naive text embeddings with remote sensing global context, creating a more adaptable and expressive linguistic latent space for the classifier. We establish new benchmarks for OV remote sensing instance segmentation across diverse datasets. Experimental results demonstrate that, our proposed method achieves SOTA performance, which provides a robust solution for large-scale, real-world geospatial analysis. Our code is available at https://github.com/HuangShiqi128/SCORE.

遥感分割开放词汇场景上下文实例分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。