针对古滑坡检测难题,提出新型分割模型提升小样本下特征提取能力。
MRIFE: A Mask-Recovering and Interactive-Feature-Enhancing Semantic Segmentation Network For Relic Landslide Detection
- 通过对比学习与掩码重建增强局部特征,提升目标区分力
- 小样本下精度达0.5347,滑坡类别IoU提升至0.3934
- 适合遥感地质灾害监测,尤其适用于标注困难场景
古滑坡因长期演化形成,具有再激活风险,是危险的地质现象。利用高分辨率遥感图像进行古滑坡语义分割面临视觉模糊和小样本数据两大挑战,前者源于自然演进与人类活动导致的外观变化,后者源于样本识别与标注困难。为此,提出一种名为掩码恢复与交互特征增强(MRIFE)的语义分割模型,以实现更高效的特征提取与分离。具体地,设计了一种结合对比学习与掩码重建的局部显著特征增强方法,提升目标与背景的区分能力及滑坡语义表示;同时采用双分支交互特征增强架构,丰富提取特征,缓解视觉模糊问题。引入自蒸馏学习,利用样本内与样本间特征多样性进行对比学习,提高样本利用率,加速模型收敛,并有效应对小样本问题。在真实古滑坡数据集上的实验表明,相较基线模型,该方法的精度从0.4226提升至0.5347,平均交并比(mIoU)从0.6405增至0.6680,滑坡类别IoU由0.3381升至0.3934,F1分数从0.5054提高到0.5646,显著提升了古滑坡检测性能。
原文摘要 · Abstract (English)
Relic landslide, formed over a long period, possess the potential for reactivation, making them a hazardous geological phenomenon. While reliable relic landslide detection benefits the effective monitoring and prevention of landslide disaster, semantic segmentation using high-resolution remote sensing images for relic landslides faces many challenges, including the object visual blur problem, due to the changes of appearance caused by prolonged natural evolution and human activities, and the small-sized dataset problem, due to difficulty in recognizing and labelling the samples. To address these challenges, a semantic segmentation model, termed mask-recovering and interactive-feature-enhancing (MRIFE), is proposed for more efficient feature extraction and separation. Specifically, a contrastive learning and mask reconstruction method with locally significant feature enhancement is proposed to improve the ability to distinguish between the target and background and represent landslide semantic features. Meanwhile, a dual-branch interactive feature enhancement architecture is used to enrich the extracted features and address the issue of visual ambiguity. Self-distillation learning is introduced to leverage the feature diversity both within and between samples for contrastive learning, improving sample utilization, accelerating model convergence, and effectively addressing the problem of the small-sized dataset. The proposed MRIFE is evaluated on a real relic landslide dataset, and experimental results show that it greatly improves the performance of relic landslide detection. For the semantic segmentation task, compared to the baseline, the precision increases from 0.4226 to 0.5347, the mean intersection over union (IoU) increases from 0.6405 to 0.6680, the landslide IoU increases from 0.3381 to 0.3934, and the F1-score increases from 0.5054 to 0.5646.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。