用少量标注数据实现无人机冰裂缝精准分割,提升极地考察安全与科研效率。
CrevasseSeg: A Label-Efficient UAV Crevasse Segmentation Framework

- 基于自监督学习,仅用24张标注图验证,176张测试
- DINOv3模型在非线性分类器下表现最佳,达75.33 mDSC
- 适合遥感图像少样本分割研究,尤其冰川监测领域
从无人飞行器(UAV)影像中进行冰裂缝测绘对冰川学研究和冰川地形野外安全至关重要。然而,冰川表面的像素级标注成本高且需领域专家。我们提出CrevasseSeg框架,用于挪威斯瓦尔巴特地区博雷布伦冰川末端的二值分割任务,包含1,938张未标注的无人机正射影像瓦片用于自监督/无监督微调,24张标注图用于验证,176张用于测试。通过该框架,我们评估了五种自监督目标:BYOL、Jensen-Shannon散度(JSD)、Barlow-Twins、VICReg及结合的BYOL-JSD,在三种架构(O-Net、O-Net++、DINOv3初始化的O-Net)上进行对比。每种配置使用两种冻结特征读出方式:线性探测器与仅在24张标注验证图上训练的非线性XGBoost分类器。核心发现是两类读出方式存在一致反转:DINOv3特征在在线性探测下最弱,但在非线性读出下最强。UMAP分析显示,DINOv3将像素分至多个小簇且类别局部交错,而卷积架构(O-Net和O-Net++)将其嵌入单一有序类流形。卫星预训练的DINOv3优于自然图像初始化,其标签高效管道(DINOv3-ViT-L-Sat-O-Net-BYOL-JSD)达到75.33 mDSC / 61.28 mIoU,超越基于相同24张标注图、以原始RGB像素为特征的标准机器学习基线。我们开源CrevasseSeg,以支持遥感中的标签高效分割研究。
原文摘要 · Abstract (English)
Crevasse mapping from uncrewed aerial vehicle (UAV) imagery matters for glaciological research and for field safety in glaciated terrain. Yet, pixel-level annotation of glacier surfaces is costly and requires domain experts. We introduce CrevasseSeg, a framework for binary segmentation over the terminus of Borebreen, Svalbard, comprising 1,938 unlabelled UAV orthomosaic tiles for self-supervised/unsupervised fine-tuning, 24 labelled tiles for validation and 176 labelled tiles for testing. Using CrevasseSeg, we benchmark five self-supervised objectives -- BYOL, a Jensen-Shannon Divergence (JSD) objective, Barlow-Twins, VICReg, and a combined BYOL-JSD objective -- across three architectures: O-Net, O-Net++, and a DINOv3-initialised O-Net. Each configuration is evaluated under two frozen-feature readouts that differ only in the form of their decision boundary: a linear probe and a non-linear XGBoost classifier fit only on the 24 labelled validation images. Our central finding is a consistent inversion between the two readouts: DINOv3 features are the weakest under linear probing but the strongest under a non-linear readout. A UMAP analysis of the learned feature space shows that DINOv3 fragments pixels into many small clusters in which the classes are locally interleaved, whereas the convolutional architectures (O-Net and O-Net++) embed them onto a single class-sorted manifold. Satellite-pretrained DINOv3 improves over natural-image initialisation across objectives, and our label-efficient DINOv3-ViT-L-Sat-O-Net-BYOL-JSD pipeline reaches 75.33 mDSC / 61.28 mIoU, outperforming standard machine learning baselines fit on the same 24 labelled images with the RGB pixel values used as features. We release CrevasseSeg to support label-efficient segmentation research in remote sensing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。