构建真实感3D点云数据集,评测模型在遮挡下的鲁棒性。
BelHouse3D: A Benchmark Dataset for Assessing Occlusion Robustness in 3D Point Cloud Semantic Segmentation
- 基于比利时32栋真实房屋建模生成合成点云数据。
- 引入遮挡测试集,模拟真实场景中的分布外情况。
- 为室内场景点云语义分割提供新基准,适合研究泛化能力的学者。
大规模2D数据集推动了机器学习的发展,但3D视觉任务进展缓慢,主要受限于高质量3D基准数据集的缺乏。尤其在室内场景点云语义分割中,真实数据采集受限于空间与成本,且逐点标注耗时且易错。尽管合成数据缓解了部分问题,却难以还原真实环境中的遮挡现象。现有3D数据集通常假设训练与测试数据独立同分布(IID),削弱了模型在真实场景中的适用性。为此,我们提出BelHouse3D,一个基于比利时32栋真实住宅构建的合成点云数据集,确保场景真实性。同时设计含遮挡的测试集,模拟分布外(OOD)场景,反映真实点云常见遮挡。我们在该设置下评估主流点云语义分割方法并建立基准。BelHouse3D及其OOD设置有望推动室内场景3D点云分割研究,助力开发更具泛化能力的模型。
原文摘要 · Abstract (English)
Large-scale 2D datasets have been instrumental in advancing machine learning; however, progress in 3D vision tasks has been relatively slow. This disparity is largely due to the limited availability of 3D benchmarking datasets. In particular, creating real-world point cloud datasets for indoor scene semantic segmentation presents considerable challenges, including data collection within confined spaces and the costly, often inaccurate process of per-point labeling to generate ground truths. While synthetic datasets address some of these challenges, they often fail to replicate real-world conditions, particularly the occlusions that occur in point clouds collected from real environments. Existing 3D benchmarking datasets typically evaluate deep learning models under the assumption that training and test data are independently and identically distributed (IID), which affects the models' usability for real-world point cloud segmentation. To address these challenges, we introduce the BelHouse3D dataset, a new synthetic point cloud dataset designed for 3D indoor scene semantic segmentation. This dataset is constructed using real-world references from 32 houses in Belgium, ensuring that the synthetic data closely aligns with real-world conditions. Additionally, we include a test set with data occlusion to simulate out-of-distribution (OOD) scenarios, reflecting the occlusions commonly encountered in real-world point clouds. We evaluate popular point-based semantic segmentation methods using our OOD setting and present a benchmark. We believe that BelHouse3D and its OOD setting will advance research in 3D point cloud semantic segmentation for indoor scenes, providing valuable insights for the development of more generalizable models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。