用多光谱点云+变换器模型,精准识别河岸地表类型。
Riverine Land Cover Mapping through Semantic Segmentation of Multispectral Point Clouds
- 基于点云的变换器模型融合几何与光谱特征进行分类
- 平均交并比达0.950,显著优于仅用几何信息的基线
- 多数据集训练提升泛化能力,适合缺乏标注数据的场景
准确的河岸环境土地覆盖制图对河流管理、生态理解及地貌变化监测至关重要。本研究探索使用点变换器v2(PTv2)——一种先进的点云深度神经网络架构——对真实河岸环境中多光谱激光雷达数据进行语义分割以实现土地覆盖制图。利用三通道激光雷达点云的几何与光谱信息,对沙地、砾石、低植被、高植被、林地表面和水体等六类地表进行分类。模型在芬兰北部奥兰卡河的数据上,结合几何与光谱特征进行训练与评估。为提升模型在新河岸环境中的泛化能力,进一步研究了加入另一条河稀疏标注数据的多数据集训练策略。结果表明,全特征配置下平均交并比(mIoU)达到0.950,显著优于仅使用几何特征的基线。消融实验显示强度与反射率特征是精确分类的关键。多数据集训练实验表现出更强的泛化性能,表明即使高质量标注数据有限,也可通过联合训练提升模型鲁棒性。本工作展示了将基于变换器的架构应用于河岸多光谱点云的潜力,为沉积物输运监测等河流管理应用提供了新工具。
原文摘要 · Abstract (English)
Accurate land cover mapping in riverine environments is essential for effective river management, ecological understanding, and geomorphic change monitoring. This study explores the use of Point Transformer v2 (PTv2), an advanced deep neural network architecture designed for point cloud data, for land cover mapping through semantic segmentation of multispectral LiDAR data in real-world riverine environments. We utilize the geometric and spectral information from the 3-channel LiDAR point cloud to map land cover classes, including sand, gravel, low vegetation, high vegetation, forest floor, and water. The PTv2 model was trained and evaluated on point cloud data from the Oulanka river in northern Finland using both geometry and spectral features. To improve the model's generalization in new riverine environments, we additionally investigate multi-dataset training that adds sparsely annotated data from an additional river dataset. Results demonstrated that using the full-feature configuration resulted in performance with a mean Intersection over Union (mIoU) of 0.950, significantly outperforming the geometry baseline. Other ablation studies revealed that intensity and reflectance features were the key for accurate land cover mapping. The multi-dataset training experiment showed improved generalization performance, suggesting potential for developing more robust models despite limited high-quality annotated data. Our work demonstrates the potential of applying transformer-based architectures to multispectral point clouds in riverine environments. The approach offers new capabilities for monitoring sediment transport and other river management applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。