通过流形蒸馏提升点云模型对旋转扰动的鲁棒性,无需坐标变换。
Rotation Perturbation Robustness in Point Cloud Analysis: A Perspective of Manifold Distillation
- 从流形视角设计蒸馏方法,利用教师网络传递旋转鲁棒性
- 在多个数据集上分类准确率提升4.92%~7.36%,分割mIoU提升4.82%~7.36%
- 无需坐标变换即可抗旋转扰动,适合高精度3D识别场景
点云通常被视为黎曼流形的离散采样,在三维图像理解中起关键作用。尤其旋转扰动——由设备偏移、系统不稳、测量误差等因素引起的微小意外旋转——极易导致点云学习任务性能下降。现有方法对旋转扰动敏感,已有鲁棒网络在性能与抗噪能力上仍有提升空间。本文从流形视角重构点云,提出一种无需坐标变换的流形蒸馏方法:训练阶段,教师网络学习旋转鲁棒性信息,并通过在线蒸馏传递给学生网络;推理阶段,学生网络直接使用原始3D坐标实现鲁棒性。在Modelnet40、ScanobjectNN、ShapeNet和S3DIS四个数据集上的实验表明,相较于主流旋转鲁棒网络,本方法在随机旋转扰动下的分类准确率分别提升4.92%和4.41%,分割任务的mIoU分别提升7.36%和4.82%。此外,该算法在抗噪声和异常值方面也表现优异。
原文摘要 · Abstract (English)
Point cloud is often regarded as a discrete sampling of Riemannian manifold and plays a pivotal role in the 3D image interpretation. Particularly, rotation perturbation, an unexpected small change in rotation caused by various factors (like equipment offset, system instability, measurement errors and so on), can easily lead to the inferior results in point cloud learning tasks. However, classical point cloud learning methods are sensitive to rotation perturbation, and the existing networks with rotation robustness also have much room for improvements in terms of performance and noise tolerance. Given these, this paper remodels the point cloud from the perspective of manifold as well as designs a manifold distillation method to achieve the robustness of rotation perturbation without any coordinate transformation. In brief, during the training phase, we introduce a teacher network to learn the rotation robustness information and transfer this information to the student network through online distillation. In the inference phase, the student network directly utilizes the original 3D coordinate information to achieve the robustness of rotation perturbation. Experiments carried out on four different datasets verify the effectiveness of our method. Averagely, on the Modelnet40 and ScanobjectNN classification datasets with random rotation perturbations, our classification accuracy has respectively improved by 4.92% and 4.41%, compared to popular rotation-robust networks; on the ShapeNet and S3DIS segmentation datasets, compared to the rotation-robust networks, the improvements of mIoU are 7.36% and 4.82%, respectively. Besides, from the experimental results, the proposed algorithm also shows excellent performance in resisting noise and outliers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。