从多视角投影中恢复3D点云,无需训练即可处理缺失点和噪声。
3DMPE: 3D Multi-Perspective Embedding

- 基于几何对应关系与可见性信息,联合优化多视角投影与点云位置。
- 在ShapeNet和Pix3D上,Chamfer Distance等指标优于现有方法。
- 适合无训练数据、需高精度重建的3D场景重建任务。
我们研究从多个部分观测的2D投影中重建3D点云。给定未知3D点云的两个或更多投影,以及跨视角点对应关系和可见性信息,目标是在不同视角包含不同子集点的情况下,恢复一致的3D配置。我们提出3D多视角嵌入(3DMPE),一种基于优化、无需训练的方法,可重建3D点云,并在可变投影设置下联合估计投影映射。3DMPE扩展了多视角联合嵌入,以适应缺失点和视图间不完整的成对距离信息。考虑固定投影和可变投影两种设置。与依赖训练数据的基于学习的重建方法不同,3DMPE作用于具有已建立对应关系的几何观测,无需类别特定训练。在ShapeNet和Pix3D上的实验使用Chamfer Distance、Earth Mover Distance和RMSE-Optimize-Align(ROA)评估重建质量,考察初始化、视图数量、点可见性及多种噪声情况(包括噪声距离和错误对应)。结果表明,3DMPE能有效从部分多视角几何观测中重建点云。
原文摘要 · Abstract (English)
We study 3D point cloud reconstruction from multiple partially observed 2D projections. Given two or more projections of an unknown 3D point cloud, together with cross-view point correspondences and visibility information, our goal is to recover a consistent 3D configuration when different views contain different subsets of points. We propose 3D Multi-Perspective Embedding (3DMPE), an optimization-based, training-free method that reconstructs the 3D point cloud and, in the variable-projection setting, jointly estimates the projection maps. 3DMPE extends Multi-Perspective Simultaneous Embedding to accommodate missing points and incomplete pairwise distance information across views. We consider both fixed-projection and variable-projection settings. Unlike learning-based reconstruction methods that infer shape from raw images and often depend on training data, 3DMPE operates on geometric observations with established correspondences and does not require category-specific training. Experiments on ShapeNet and Pix3D evaluate reconstruction quality using Chamfer Distance, Earth Mover Distance, and RMSE-Optimize-Align (ROA), and examine the effects of initialization, the number of views, point visibility, and several noise regimes, including noisy distances and erroneous correspondences. The results demonstrate that 3DMPE can effectively reconstruct point clouds from partial multi-view geometric observations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。