arXiv:2504.12619cs.CV2025-04被引 12

用自适应傅里叶适配和边缘约束光流,提升遥感建筑变化检测精度

SAM-Based Building Change Detection with Distribution-Aware Fourier Adaptation and Edge-Constrained Warping

  • 引入分布感知傅里叶适配器,解决遥感领域差异与建筑分布不均问题
  • 设计边缘约束光流模块,减少噪声干扰,提升变化区域边缘识别能力
  • 在LEVIR-CD、S2Looking等数据集上达到当前最优性能,适合遥感变化检测应用

建筑变化检测在城市开发、灾情评估和军事侦察中仍具挑战性。尽管基础模型如分割一切模型(SAM)具备强大分割能力,但其在建筑变化检测任务中受限于领域差距。现有基于适配器的微调方法因建筑分布不均,导致细微变化检测差、边缘提取不准。此外,双时相图像错位问题虽常由光流处理,但仍易受背景噪声影响,降低变化检测准确性和边缘识别。为此,本文提出基于SAM的FAEWNet网络,结合分布感知傅里叶适配与边缘约束光流。该网络利用SAM编码器提取遥感图像丰富特征,并通过分布感知傅里叶聚合适配器,聚焦任务相关变化信息,缓解领域差距并关注变化建筑分布。同时,设计新型光流模块,增强对建筑物边缘的感知,抑制高度偏移估计中的噪声干扰。在LEVIR-CD、S2Looking和WHU-CD数据集上取得当前最优结果,代码已开源。

原文摘要 · Abstract (English)

Building change detection remains challenging for urban development, disaster assessment, and military reconnaissance. While foundation models like Segment Anything Model (SAM) show strong segmentation capabilities, SAM is limited in the task of building change detection due to domain gap issues. Existing adapter-based fine-tuning approaches face challenges with imbalanced building distribution, resulting in poor detection of subtle changes and inaccurate edge extraction. Additionally, bi-temporal misalignment in change detection, typically addressed by optical flow, remains vulnerable to background noises. This affects the detection of building changes and compromises both detection accuracy and edge recognition. To tackle these challenges, we propose a new SAM-Based Network with Distribution-Aware Fourier Adaptation and Edge-Constrained Warping (FAEWNet) for building change detection. FAEWNet utilizes the SAM encoder to extract rich visual features from remote sensing images. To guide SAM in focusing on specific ground objects in remote sensing scenes, we propose a Distribution-Aware Fourier Aggregated Adapter to aggregate task-oriented changed information. This adapter not only effectively addresses the domain gap issue, but also pays attention to the distribution of changed buildings. Furthermore, to mitigate noise interference and misalignment in height offset estimation, we design a novel flow module that refines building edge extraction and enhances the perception of changed buildings. Our state-of-the-art results on the LEVIR-CD, S2Looking and WHU-CD datasets highlight the effectiveness of FAEWNet. The code is available at https://github.com/SUPERMAN123000/FAEWNet.

变化检测遥感图像SAM边缘感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。