针对多光谱点云长尾分布问题,提出自适应多尺度融合分类方法。
An Enhanced Classification Method Based on Adaptive Multi-Scale Fusion for Long-tailed Multispectral Point Clouds
- 通过网格平衡采样生成稀疏标注数据的训练样本
- 多尺度特征融合模块有效保留地物细粒度信息
- 自适应混合损失提升小类分类性能,适合野外场景
多光谱点云(MPC)可捕获场景的三维空间-光谱信息,用于场景理解并具有广泛应用。然而,现有分类方法主要在室内数据集上测试,应用于室外数据时仍面临标注目标稀疏、地物尺度差异大及长尾分布等问题。为此,提出一种基于自适应多尺度融合的MPC长尾分类增强方法。在训练集生成阶段,设计网格平衡采样策略,从稀疏标注数据中可靠生成训练样本;在特征学习阶段,提出多尺度特征融合模块,融合不同尺度下地物的浅层特征,解决因地物尺度变化导致的细粒度特征丢失问题;在分类阶段,设计自适应混合损失模块,采用带自适应权重的多分类头,平衡各类别学习能力,提升因尺度多样性和长尾分布导致的小类分类性能。在三个MPC数据集上的实验结果表明,该方法优于当前最先进方法。
原文摘要 · Abstract (English)
Multispectral point cloud (MPC) captures 3D spatial-spectral information from the observed scene, which can be used for scene understanding and has a wide range of applications. However, most of the existing classification methods were extensively tested on indoor datasets, and when applied to outdoor datasets they still face problems including sparse labeled targets, differences in land-covers scales, and long-tailed distributions. To address the above issues, an enhanced classification method based on adaptive multi-scale fusion for MPCs with long-tailed distributions is proposed. In the training set generation stage, a grid-balanced sampling strategy is designed to reliably generate training samples from sparse labeled datasets. In the feature learning stage, a multi-scale feature fusion module is proposed to fuse shallow features of land-covers at different scales, addressing the issue of losing fine features due to scale variations in land-covers. In the classification stage, an adaptive hybrid loss module is devised to utilize multi-classification heads with adaptive weights to balance the learning ability of different classes, improving the classification performance of small classes due to various-scales and long-tailed distributions in land-covers. Experimental results on three MPC datasets demonstrate the effectiveness of the proposed method compared with the state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。