用航空影像自动识别死树,跨区域标注数据少也能准
ADA-Net: Attention-Guided Domain Adaptation Network with Contrastive Learning for Standing Dead Tree Segmentation Using Aerial Imagery
- 用注意力引导的域适应网络,把无标注区域图像转成有标注风格
- 在芬兰和美国数据集上测试,死树分割精度达新高
- 适合做森林生态监测、遥感图像分析的研究者和从业者
林木死亡信息对理解森林生态系统功能与韧性至关重要,但大范围数据仍严重缺失。气候变化引发的大规模树木死亡事件常因数据不足而未被发现。本文提出一种基于航空多光谱正射影像的死树分割新方法。针对森林遥感中依赖专业标注导致数据稀缺的问题,提出通过域适应技术将源域X(无标注)图像转换为目标域Y(有标注),利用预训练分割网络实现迁移学习。本研究构建了新型注意力引导域适应网络(ADA-Net),结合增强对比学习,在图像到图像翻译任务中显著提升性能。在芬兰和美国两个数据集上验证,将美国图像转换至芬兰域后,生成的USA2Finland数据集与芬兰原图特征高度相似。代码开源于https://github.com/meteahishali/ADA-Net,数据集公开于https://www.kaggle.com/datasets/meteahishali/aerial-imagery-for-standing-dead-tree-segmentation。
原文摘要 · Abstract (English)
Information on standing dead trees is important for understanding forest ecosystem functioning and resilience but has been lacking over large geographic regions. Climate change has caused large-scale tree mortality events that can remain undetected due to limited data. In this study, we propose a novel method for segmenting standing dead trees using aerial multispectral orthoimages. Because access to annotated datasets has been a significant problem in forest remote sensing due to the need for forest expertise, we introduce a method for domain transfer by leveraging domain adaptation to learn a transformation from a source domain X to target domain Y. In this Image-to-Image translation task, we aim to utilize available annotations in the target domain by pre-training a segmentation network. When images from a new study site without annotations are introduced (source domain X), these images are transformed into the target domain. Then, transfer learning is applied by inferring the pre-trained network on domain-adapted images. In addition to investigating the feasibility of current domain adaptation approaches for this objective, we propose a novel approach called the Attention-guided Domain Adaptation Network (ADA-Net) with enhanced contrastive learning. Accordingly, the ADA-Net approach provides new state-of-the-art domain adaptation performance levels outperforming existing approaches. We have evaluated the proposed approach using two datasets from Finland and the US. The USA images are converted to the Finland domain, and we show that the synthetic USA2Finland dataset exhibits similar characteristics to the Finland domain images. The software implementation is shared at https://github.com/meteahishali/ADA-Net. The data is publicly available at https://www.kaggle.com/datasets/meteahishali/aerial-imagery-for-standing-dead-tree-segmentation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。