arXiv:2509.24150cs.GRcs.CV2025-09SIGGRAPH被引 3

用神经网络解决点云可见性问题,速度快且抗噪能力强。

Neural Visibility of Point Sets

  • 将可见性判断转为二分类任务,结合3D U-Net与MLP提取特征并预测。
  • 在大型点云上速度提升126倍,准确率显著优于传统HPR方法。
  • 适用于可视化、重建、法向估计等场景,对噪声和密度变化鲁棒。

点云是三维数据的常用表示,但其稀疏性和缺乏显式连接使得从给定视角判断点的可见性仍具挑战。传统方法如隐藏点移除(HPR)在计算效率、抗噪能力及处理凹区域或低密度点云方面存在局限。本文提出一种新方法,将点云可见性判断建模为二分类任务。网络核心由3D U-Net提取与视角无关的点级特征,以及共享的多层感知机(MLP)根据特征和视点方向预测可见性。模型在渲染的3D模型生成的真实标签下端到端训练。实验表明,该方法在ShapeNet、ABC Dataset及真实世界数据集上均显著优于HPR,准确率大幅提升,且在大点云上实现最高126倍的速度提升。模型对噪声和点云密度变化具有强鲁棒性,并能良好泛化至未见形状。此外,本文展示了该方法在点云可视化、表面重建、法向估计、阴影渲染和视角优化等多场景中的应用潜力。代码与模型已开源。

原文摘要 · Abstract (English)

Point clouds are widely used representations of 3D data, but determining the visibility of points from a given viewpoint remains a challenging problem due to their sparse nature and lack of explicit connectivity. Traditional methods, such as Hidden Point Removal (HPR), face limitations in computational efficiency, robustness to noise, and handling concave regions or low-density point clouds. In this paper, we propose a novel approach to visibility determination in point clouds by formulating it as a binary classification task. The core of our network consists of a 3D U-Net that extracts view-independent point-wise features and a shared multi-layer perceptron (MLP) that predicts point visibility using the extracted features and view direction as inputs. The network is trained end-to-end with ground-truth visibility labels generated from rendered 3D models. Our method significantly outperforms HPR in both accuracy and computational efficiency, achieving up to 126 times speedup on large point clouds. Additionally, our network demonstrates robustness to noise and varying point cloud densities and generalizes well to unseen shapes. We validate the effectiveness of our approach through extensive experiments on the ShapeNet, ABC Dataset and real-world datasets, showing substantial improvements in visibility accuracy. We also demonstrate the versatility of our method in various applications, including point cloud visualization, surface reconstruction, normal estimation, shadow rendering, and viewpoint optimization. Our code and models are available at https://github.com/octree-nn/neural-visibility.

点云可见性神经网络3D重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。