仅用150张图像训练树冠分割模型,轻量CNN表现优于大模型。
Sparse Data Tree Canopy Segmentation: Fine-Tuning Leading Pretrained Models on Only 150 Images
- 在仅150张标注图上微调主流模型,对比其泛化能力
- YOLOv11和Mask R-CNN准确率远超Transformer类模型
- 适合数据稀缺场景的树冠检测,推荐轻量CNN方案
从航拍影像中识别树冠是环境监测、城市规划和生态系统分析的重要任务。受真实数据标注稀缺性影响,Solafune树冠检测竞赛提供了一个仅含150张标注图像且分布不均的小型数据集,给深度模型训练带来严重过拟合挑战。本文评估了五种代表性架构:YOLOv11、Mask R-CNN、DeepLabv3、Swin-UNet和DINOv2,在极端数据稀缺条件下的适用性。实验表明,预训练卷积模型(尤其是YOLOv11和Mask R-CNN)的泛化性能显著优于预训练Transformer模型。DeepLabv3、Swin-UNet和DINOv2表现较差,可能源于语义与实例分割任务差异、视觉变换器对数据量要求高,以及缺乏强归纳偏置。研究还分析了训练策略、增强方案及模型在小数据约束下的行为,证实轻量级CNN方法在有限影像下仍是最可靠的树冠检测选择。
原文摘要 · Abstract (English)
Tree canopy detection from aerial imagery is an important task for environmental monitoring, urban planning, and ecosystem analysis. Simulating real-life data annotation scarcity, the Solafune Tree Canopy Detection competition provides a small and imbalanced dataset of only 150 annotated images, posing significant challenges for training deep models without severe overfitting. In this work, we evaluate five representative architectures, YOLOv11, Mask R-CNN, DeepLabv3, Swin-UNet, and DINOv2, to assess their suitability for canopy segmentation under extreme data scarcity. Our experiments show that pretrained convolution-based models, particularly YOLOv11 and Mask R-CNN, generalize significantly better than pretrained transformer-based models. DeeplabV3, Swin-UNet and DINOv2 underperform likely due to differences between semantic and instance segmentation tasks, the high data requirements of Vision Transformers, and the lack of strong inductive biases. These findings confirm that transformer-based architectures struggle in low-data regimes without substantial pretraining or augmentation and that differences between semantic and instance segmentation further affect model performance. We provide a detailed analysis of training strategies, augmentation policies, and model behavior under the small-data constraint and demonstrate that lightweight CNN-based methods remain the most reliable for canopy detection on limited imagery.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。