arXiv:2510.15386cs.CV2025-10

让3D高斯点云能融合多角度图像,完整重建被遮挡物体。

PFGS: Pose-Fused 3D Gaussian Splatting for Complete Multi-Pose Object Reconstruction

  • 通过姿态感知融合策略,将多视角图像逐步合并到主视角的3D高斯表示中。
  • 在多个数据集上实现更完整的重建,细节保留更真实,优于现有方法。
  • 适合需要高精度三维重建的工业扫描、文物数字化等场景。

近年来,3D高斯点云(3DGS)实现了从多视角图像出发的高质量实时新视图合成。然而,现有方法大多假设物体在单一静态姿态下拍摄,导致重建结果缺失被遮挡或自遮挡区域。本文提出PFGS,一种面向多姿态图像的3DGS框架,可完成完整物体重建。给定一个主姿态及若干辅助姿态的图像,PFGS通过迭代融合将每个辅助视角信息整合至主视角的统一3DGS表示中。其姿态感知融合策略结合全局与局部配准,有效合并视角并优化模型。尽管近期3D基础模型提升了配准的鲁棒性与效率,仍受限于高内存开销和精度不足。PFGS通过智能整合这些模型:利用背景特征进行每姿态相机位姿估计,并以基础模型实现跨姿态配准,兼顾性能与一致性。实验表明,PFGS在定性和定量评估中持续优于强基线,在重建完整性与视觉保真度上表现更优。

原文摘要 · Abstract (English)

Recent advances in 3D Gaussian Splatting (3DGS) have enabled high-quality, real-time novel-view synthesis from multi-view images. However, most existing methods assume the object is captured in a single, static pose, resulting in incomplete reconstructions that miss occluded or self-occluded regions. We introduce PFGS, a pose-aware 3DGS framework that addresses the practical challenge of reconstructing complete objects from multi-pose image captures. Given images of an object in one main pose and several auxiliary poses, PFGS iteratively fuses each auxiliary set into a unified 3DGS representation of the main pose. Our pose-aware fusion strategy combines global and local registration to merge views effectively and refine the 3DGS model. While recent advances in 3D foundation models have improved registration robustness and efficiency, they remain limited by high memory demands and suboptimal accuracy. PFGS overcomes these challenges by incorporating them more intelligently into the registration process: it leverages background features for per-pose camera pose estimation and employs foundation models for cross-pose registration. This design captures the best of both approaches while resolving background inconsistency issues. Experimental results demonstrate that PFGS consistently outperforms strong baselines in both qualitative and quantitative evaluations, producing more complete reconstructions and higher-fidelity 3DGS models.

3D重建高斯点云多姿态融合视觉建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。