提出轻量适配器网络,让遥感变化检测模型跨数据集通用。
Lightweight Adapter Learning for More Generalized Remote Sensing Change Detection
- 设计共享与特定模块,用轻量适配器快速适配新数据集。
- 在多个数据集上达到良好性能,仅更新4.1%-7.7%参数。
- 适合需快速部署、标注差异大的遥感变化检测场景。
深度学习在遥感图像变化检测中表现优异,但现有方法通常为每个数据集训练专用网络。由于数据分布和标注差异显著,专用网络泛化能力差。本文提出变化适配网络(CANet),包含共享与数据集特定学习模块。前者提取图像判别特征,后者设计轻量适配器模型以应对不同数据集的分布与标注特性。适配器可低成本快速泛化至新任务。文中引入一种自适应变化区域掩码(ICM),聚焦关注变化对象,降低标注差异影响。此外,为每类数据集设计独特批归一化层,缓解分布差异。实验表明,相比现有方法,CANet在多个公开数据集上同时取得满意检测性能,具备更强泛化能力、更小训练成本(仅更新4.1%-7.7%参数),且在有限训练数据下表现更优,可灵活集成到现有深度模型中。
原文摘要 · Abstract (English)
Deep learning methods have shown promising performances in remote sensing image change detection (CD). However, existing methods usually train a dataset-specific deep network for each dataset. Due to the significant differences in the data distribution and labeling between various datasets, the trained dataset-specific deep network has poor generalization performances on other datasets. To solve this problem, this paper proposes a change adapter network (CANet) for a more universal and generalized CD. CANet contains dataset-shared and dataset-specific learning modules. The former explores the discriminative features of images, and the latter designs a lightweight adapter model, to deal with the characteristics of different datasets in data distribution and labeling. The lightweight adapter can quickly generalize the deep network for new CD tasks with a small computation cost. Specifically, this paper proposes an interesting change region mask (ICM) in the adapter, which can adaptively focus on interested change objects and decrease the influence of labeling differences in various datasets. Moreover, CANet adopts a unique batch normalization layer for each dataset to deal with data distribution differences. Compared with existing deep learning methods, CANet can achieve satisfactory CD performances on various datasets simultaneously. Experimental results on several public datasets have verified the effectiveness and advantages of the proposed CANet on CD. CANet has a stronger generalization ability, smaller training costs (merely updating 4.1%-7.7% parameters), and better performances under limited training datasets than other deep learning methods, which also can be flexibly inserted with existing deep models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。