arXiv:2412.04714cs.CVcs.AI2024-12被引 6

直接用3D点云训练视觉Transformer,提升树种分类精度与效率

PCTreeS: 3D Point Cloud Tree Species Classification Using Airborne LiDAR Images

  • 将3D点云输入视觉Transformer,避免传统2D投影信息损失
  • 在热带草原数据上达成0.81的AUC和0.72的准确率,训练仅需45分钟
  • 适合需要大规模自动树种识别的研究者与生态监测项目

可靠的森林状态大数据对监测生态系统健康、碳储量及气候变化影响至关重要。当前树种分布知识主要依赖人工野外采集,耗时数年,数据集有限且覆盖范围小。近期研究表明,基于激光雷达(LiDAR)图像的深度学习模型可在多种生态系统中实现高精度、可扩展的树种分类。尽管LiDAR图像包含丰富3D信息,多数先前工作将其降维为2D投影以使用卷积神经网络(CNN)。本文有三项贡献:(1) 将深度学习框架应用于热带草原树种分类;(2) 使用分辨率较低但更具可扩展性的机载LiDAR图像,替代多数研究中使用的地面激光雷达;(3) 提出直接将3D点云输入视觉变压器模型(PCTreeS)的新方法。结果表明,PCTreeS在AUC(0.81)、总体准确率(0.72)及训练时间(约45分钟)上均优于现有基于2D投影的CNN基线。本文也推动了更广泛的LiDAR图像采集与验证,以实现树种大尺度自动分类。

原文摘要 · Abstract (English)

Reliable large-scale data on the state of forests is crucial for monitoring ecosystem health, carbon stock, and the impact of climate change. Current knowledge of tree species distribution relies heavily on manual data collection in the field, which often takes years to complete, resulting in limited datasets that cover only a small subset of the world's forests. Recent works show that state-of-the-art deep learning models using Light Detection and Ranging (LiDAR) images enable accurate and scalable classification of tree species in various ecosystems. While LiDAR images contain rich 3D information, most previous works flatten the 3D images into 2D projections to use Convolutional Neural Networks (CNNs). This paper offers three significant contributions: (1) we apply the deep learning framework for tree classification in tropical savannas; (2) we use Airborne LiDAR images, which have a lower resolution but greater scalability than Terrestrial LiDAR images used in most previous works; (3) we introduce the approach of directly feeding 3D point cloud images into a vision transformer model (PCTreeS). Our results show that the PCTreeS approach outperforms current CNN baselines with 2D projections in AUC (0.81), overall accuracy (0.72), and training time (~45 mins). This paper also motivates further LiDAR image collection and validation for accurate large-scale automatic classification of tree species.

3D点云树种分类视觉TransformerLiDAR

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。