arXiv:2506.03594cs.GRcs.CV2025-06ICCV被引 14

用两张姿态图重建可动物体,实时生成逼真新视角画面。

SplArt: Articulation Estimation and Part-Level Reconstruction with 3D Gaussian Splatting

  • 通过可微移动参数增强3D高斯点云,实现部件分割。
  • 多阶段优化提升精度,无需3D标注也能稳定运行。
  • 适合虚拟现实、机器人等需快速真实渲染的场景。

日常环境中普遍存在可动物体,其重建对增强/虚拟现实和机器人应用至关重要。现有方法存在可扩展性差(需3D监督或昂贵标注)、鲁棒性不足(易陷入局部最优)及渲染性能弱(速度慢或不逼真)等问题。本文提出SplArt,一种自监督、类别无关的框架,利用3D高斯点云(3DGS)从两组不同姿态的RGB图像中重建可动物体并推断运动关系,支持新视角与新姿态下的实时逼真渲染。SplArt在每个高斯点上引入可微移动参数,实现精细部件分割;采用多阶段优化策略,逐步完成重建、部件分割与运动估计,显著提升鲁棒性与准确性。该方法依赖几何自监督,无需3D标注或类别先验,可在复杂场景下有效工作。在既有与新提出的基准上评估,并使用手持相机在真实场景中验证,结果表明SplArt达到当前最佳性能且具备实际应用价值。代码已开源:https://github.com/ripl/splart。

原文摘要 · Abstract (English)

Reconstructing articulated objects prevalent in daily environments is crucial for applications in augmented/virtual reality and robotics. However, existing methods face scalability limitations (requiring 3D supervision or costly annotations), robustness issues (being susceptible to local optima), and rendering shortcomings (lacking speed or photorealism). We introduce SplArt, a self-supervised, category-agnostic framework that leverages 3D Gaussian Splatting (3DGS) to reconstruct articulated objects and infer kinematics from two sets of posed RGB images captured at different articulation states, enabling real-time photorealistic rendering for novel viewpoints and articulations. SplArt augments 3DGS with a differentiable mobility parameter per Gaussian, achieving refined part segmentation. A multi-stage optimization strategy is employed to progressively handle reconstruction, part segmentation, and articulation estimation, significantly enhancing robustness and accuracy. SplArt exploits geometric self-supervision, effectively addressing challenging scenarios without requiring 3D annotations or category-specific priors. Evaluations on established and newly proposed benchmarks, along with applications to real-world scenarios using a handheld RGB camera, demonstrate SplArt's state-of-the-art performance and real-world practicality. Code is publicly available at https://github.com/ripl/splart.

3D重建可动物体高斯点云自监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。