用高质量超点提升屋顶平面实例分割,显著降低标注成本。
SPPSFormer: High-quality Superpoint-based Transformer for Roof Plane Instance Segmentation from Point Clouds
- 提出两阶段超点生成法,确保边界精准、几何一致
- 在多个数据集上达最新性能,且对边界标注不敏感
- 适合点云质量波动大的真实场景应用
Transformer在点云屋顶平面实例分割中应用较少,现有超点Transformer因使用低质量超点导致性能受限。本文提出高质量超点的两项标准,并设计两阶段超点生成流程,使超点具备精确边界与一致几何形态,显著提升超点Transformer的特征学习能力。为弥补小样本下深度特征不足,引入多维手工特征。设计融合柯尔莫哥洛夫-阿诺德网络与Transformer的解码器以优化实例预测和掩码提取。最后通过传统后处理精修结果。构建并修正了真实世界数据集及RoofN3D数据集注释错误。实验表明,本方法在自建数据集及原始与重标注的RoofN3D数据集上均达到领先性能。模型对平面边界标注不敏感,大幅降低标注负担。综合实验揭示:屋顶类型外,点云密度、密度均匀性及3D点精度显著影响分割效果,强调需结合点云质量的数据增强策略以提升模型鲁棒性。
原文摘要 · Abstract (English)
Transformers have been seldom employed in point cloud roof plane instance segmentation, which is the focus of this study, and existing superpoint Transformers suffer from limited performance due to the use of low-quality superpoints. To address this challenge, we establish two criteria that high-quality superpoints for Transformers should satisfy and introduce a corresponding two-stage superpoint generation process. The superpoints generated by our method not only have accurate boundaries, but also exhibit consistent geometric sizes and shapes, both of which greatly benefit the feature learning of superpoint Transformers. To compensate for the limitations of deep learning features when the training set size is limited, we incorporate multidimensional handcrafted features into the model. Additionally, we design a decoder that combines a Kolmogorov-Arnold Network with a Transformer module to improve instance prediction and mask extraction. Finally, our network's predictions are refined using traditional algorithm-based postprocessing. For evaluation, we annotated a real-world dataset and corrected annotation errors in the existing RoofN3D dataset. Experimental results show that our method achieves state-of-the-art performance on our dataset, as well as both the original and reannotated RoofN3D datasets. Moreover, our model is not sensitive to plane boundary annotations during training, significantly reducing the annotation burden. Through comprehensive experiments, we also identified key factors influencing roof plane segmentation performance: in addition to roof types, variations in point cloud density, density uniformity, and 3D point precision have a considerable impact. These findings underscore the importance of incorporating data augmentation strategies that account for point cloud quality to enhance model robustness under diverse and challenging conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。