arXiv:2501.04934cs.CV2025-01中稿 · ISPRS Journal of P…被引 13

解决高分辨率遥感图像中密集变化目标的误判问题,提升弱监督变化检测精度。

Plug-and-Play DISep: Separating Dense Instances for Scene-to-Pixel Weakly-Supervised Change Detection in High-Resolution Remote Sensing Images

  • 通过三步迭代流程分离密集变化实例,避免像素混淆。
  • 在5个数据集上提升7种主流方法性能,效果显著。
  • 插件式设计,不增加推理开销,适用于多种模型架构。

现有弱监督变化检测方法在场景级监督下常出现“实例混淆”问题,尤其在变化目标密集分布时,变化实例间的未变像素被错误识别为变化,导致多个变化被误判为单一变化,影响变化数量的准确量化。为此,本文提出一种可插拔的密集实例分离(DISep)方法,在场景级监督下从统一实例视角优化像素特征。DISep包含三步迭代训练:1)实例定位:利用高通类激活图定位变化像素的候选区域;2)实例检索:通过连通性搜索将变化像素归类为不同实例ID,并按实例提取像素级特征;3)实例分离:引入分离损失,强化嵌入空间内实例内部像素的一致性,确保可区分的实例特征表示。DISep仅增加少量训练成本,无推理开销,可无缝集成至现有WSCD方法。在LEVIR-CD、WHU-CD、DSIFN-CD、SYSU-CD和CDD数据集上,通过增强3种基于Transformer和4种基于ConvNet的方法,实现当前最优性能。此外,DISep亦可提升全监督变化检测方法。代码已开源。

原文摘要 · Abstract (English)

Existing Weakly-Supervised Change Detection (WSCD) methods often encounter the problem of "instance lumping" under scene-level supervision, particularly in scenarios with a dense distribution of changed instances (i.e., changed objects). In these scenarios, unchanged pixels between changed instances are also mistakenly identified as changed, causing multiple changes to be mistakenly viewed as one. In practical applications, this issue prevents the accurate quantification of the number of changes. To address this issue, we propose a Dense Instance Separation (DISep) method as a plug-and-play solution, refining pixel features from a unified instance perspective under scene-level supervision. Specifically, our DISep comprises a three-step iterative training process: 1) Instance Localization: We locate instance candidate regions for changed pixels using high-pass class activation maps. 2) Instance Retrieval: We identify and group these changed pixels into different instance IDs through connectivity searching. Then, based on the assigned instance IDs, we extract corresponding pixel-level features on a per-instance basis. 3) Instance Separation: We introduce a separation loss to enforce intra-instance pixel consistency in the embedding space, thereby ensuring separable instance feature representations. The proposed DISep adds only minimal training cost and no inference cost. It can be seamlessly integrated to enhance existing WSCD methods. We achieve state-of-the-art performance by enhancing {three Transformer-based and four ConvNet-based methods} on the LEVIR-CD, WHU-CD, DSIFN-CD, SYSU-CD, and CDD datasets. Additionally, our DISep can be used to improve fully-supervised change detection methods. Code is available at https://github.com/zhenghuizhao/Plug-and-Play-DISep-for-Change-Detection.

变化检测弱监督实例分离遥感图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。