通过内容感知增强提升遥感变化检测精度
CFNet: Optimizing Remote Sensing Change Detection through Content-Aware Enhancement
- 设计内容聚焦网络,优先提取图像内容特征
- 在三个数据集上实现超80%的F1分数
- 适合遥感图像分析与变化检测研究者
变化检测是遥感中一项关键且广泛应用的任务,旨在识别和分析同一地理区域随时间发生的改变。由于获取条件差异,双时相遥感影像常表现出显著的风格差异。尽管深度神经网络具备强大泛化能力,这些不可预测的风格变化仍会影响模型对变化区域的准确检测。为此,我们提出内容聚焦网络(CFNet),以内容感知策略为核心。CFNet采用EfficientNet-B5作为主干网络进行特征提取。为增强模型对图像内容特征的关注,同时抑制风格特征的干扰,提出内容感知约束策略。此外,为使模型在不同阶段灵活聚焦变化与未变化区域,设计基于双时相图像特征余弦距离的重加权模块,称为Focuser。CFNet在三个知名变化检测数据集上表现优异:CLCD(F1: 81.41%,IoU: 68.65%)、LEVIR-CD(F1: 92.18%,IoU: 85.49%)和SYSU-CD(F1: 82.89%,IoU: 70.78%)。代码与预训练模型已开源于https://github.com/wifiBlack/CFNet。
原文摘要 · Abstract (English)
Change detection is a crucial and widely applied task in remote sensing, aimed at identifying and analyzing changes occurring in the same geographical area over time. Due to variability in acquisition conditions, bi-temporal remote sensing images often exhibit significant differences in image style. Even with the powerful generalization capabilities of DNNs, these unpredictable style variations between bi-temporal images inevitably affect model's ability to accurately detect changed areas. To address issue above, we propose the Content Focuser Network (CFNet), which takes content-aware strategy as a key insight. CFNet employs EfficientNet-B5 as the backbone for feature extraction. To enhance the model's focus on the content features of images while mitigating the misleading effects of style features, we develop a constraint strategy that prioritizes the content features of bi-temporal images, termed Content-Aware. Furthermore, to enable the model to flexibly focus on changed and unchanged areas according to the requirements of different stages, we design a reweighting module based on the cosine distance between bi-temporal image features, termed Focuser. CFNet achieve outstanding performance across three well-known change detection datasets: CLCD (F1: 81.41%, IoU: 68.65%), LEVIR-CD (F1: 92.18%, IoU: 85.49%), and SYSU-CD (F1: 82.89%, IoU: 70.78%). The code and pretrained models of CFNet are publicly released at https://github.com/wifiBlack/CFNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。