用自监督与迁移学习减少标注数据,提升森林点云的树识别与分类精度。
Label-Efficient 3D Forest Mapping: Self-Supervised and Transfer Learning for Instance Segmentation, Semantic Segmentation, and Species Classification
- 通过自监督和领域自适应,降低对标注数据依赖。
- 实例分割准确率提升16.98%,语义分割提升1.79%,物种分类提升6.07%。
- 统一框架支持从点云到物种分类全流程,开源可复用。
个体树木级别的详细结构与物种信息对精准林业、生物多样性保护及碳储量估算日益重要。机载与地面激光扫描生成的点云是规模化获取此类信息的最佳数据源。深度学习虽提升了树木分割与分类能力,但需大量标注数据,而复杂森林中高质量标注成本高昂且难以扩展。本文探索自监督与迁移学习策略,以减少对大规模标注数据的依赖。目标是在实例分割、语义分割与物种分类三项任务上提升性能,使用真实操作数据集训练。结果表明:相比从头训练,实例分割中自监督结合领域自适应使AP50提升16.98%;语义分割中自监督单独使用使mIoU提升1.79%;物种分类中分层迁移学习使平均Jaccard提升6.07%。我们构建了统一框架,实现从原始点云到树木划分、结构分析与物种分类的自动化流程。预训练模型可降低约21%的能耗与碳排放。该开源工作旨在加速激光扫描点云在林业、生物多样性和碳汇领域的应用。
原文摘要 · Abstract (English)
Detailed structural and species information on individual tree level is increasingly important to support precision forestry, biodiversity conservation, and provide reference data for biomass and carbon mapping. Point clouds from airborne and ground-based laser scanning are currently the most suitable data source to rapidly derive such information at scale. Recent advancements in deep learning improved segmenting and classifying individual trees and identifying semantic tree components. However, deep learning models typically require large amounts of annotated training data which limits further improvement. Producing dense, high-quality annotations for 3D point clouds, especially in complex forests, is labor-intensive and challenging to scale. We explore strategies to reduce dependence on large annotated datasets using self-supervised and transfer learning. Our objective is to improve performance across three tasks: instance segmentation, semantic segmentation, and tree classification using realistic and operational training sets. We observe improvements across all tasks, compared to training from scratch, evaluated with their respective metrics. For instance segmentation, self-supervised learning combined with domain adaptation improves AP50 by 16.98%. For semantic segmentation, self-supervised learning alone improves mIoU by 1.79%. For tree classification, hierarchical transfer learning improves mean Jaccard by 6.07%. To simplify use and encourage uptake, we integrated the tasks into a unified framework, streamlining the process from raw point clouds to tree delineation, structural analysis, and species classification. Pretrained models reduce energy consumption and carbon emissions by ~21%. This open-source contribution aims to accelerate operational extraction of individual tree information from laser scanning point clouds to support forestry, biodiversity, and carbon mapping.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。