动态词典学习提升遥感图像细粒度分割精度
Dynamic Dictionary Learning for Remote Sensing Image Segmentation
- 用可迭代更新的词典显式建模类别语义,结合跨注意力机制自适应调整嵌入
- 在LoveDA和UAVid数据集上优于现有方法,尤其在云层厚度等细粒度任务中提升显著
- 适合需要高精度分割的遥感场景,如城市变化检测与环境监测
遥感图像分割面临形态相似类别区分难、场景差异大等挑战。现有方法依赖隐式表征学习,难以根据上下文动态调整语义嵌入,导致在云层厚度等细粒度任务中表现不佳。本文提出一种动态词典学习框架,通过多阶段交替交叉注意力机制,迭代优化类级别语义嵌入。该过程使表示学习能适应输入特性,有效缓解类内异质性和类间同质性带来的歧义。为进一步增强判别力,对词典空间施加对比约束,确保类内紧凑、类间分离。在粗粒度与细粒度数据集上的实验表明,该方法持续优于当前最优模型,尤其在两个在线测试基准(LoveDA 和 UAVid)中表现突出。代码已公开于 https://anonymous.4open.science/r/D2LS-8267/。
原文摘要 · Abstract (English)
Remote sensing image segmentation faces persistent challenges in distinguishing morphologically similar categories and adapting to diverse scene variations. While existing methods rely on implicit representation learning paradigms, they often fail to dynamically adjust semantic embeddings according to contextual cues, leading to suboptimal performance in fine-grained scenarios such as cloud thickness differentiation. This work introduces a dynamic dictionary learning framework that explicitly models class ID embeddings through iterative refinement. The core contribution lies in a novel dictionary construction mechanism, where class-aware semantic embeddings are progressively updated via multi-stage alternating cross-attention querying between image features and dictionary embeddings. This process enables adaptive representation learning tailored to input-specific characteristics, effectively resolving ambiguities in intra-class heterogeneity and inter-class homogeneity. To further enhance discriminability, a contrastive constraint is applied to the dictionary space, ensuring compact intra-class distributions while maximizing inter-class separability. Extensive experiments across both coarse- and fine-grained datasets demonstrate consistent improvements over state-of-the-art methods, particularly in two online test benchmarks (LoveDA and UAVid). Code is available at https://anonymous.4open.science/r/D2LS-8267/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。