arXiv:2502.19459cs.CVcs.GR2025-02ICLR被引 74

用高斯点云重建复杂可动物体,精度效率双提升

ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splatting

  • 用3D高斯点云分阶段对齐不同状态的部件信息
  • 在合成与真实数据集上实现最佳重建精度与参数估计
  • 适合需要高保真可动模型的场景,如虚拟交互

构建可动物体是计算机视觉的关键挑战。现有方法难以有效融合不同状态下的信息,导致部件网格重建和运动建模精度受限,尤其针对复杂多部件可动物体。本文提出ArtGS,利用3D高斯点云作为灵活高效的表示方式,引入规范高斯点云并采用粗到细初始化与更新策略,以对齐不同状态下的部件信息,并设计基于皮肤绑定的部件运动建模模块,同时提升部件网格重建与运动学习性能。在合成与真实世界数据集上的大量实验,包括一个全新的复杂多部件物体基准测试,表明ArtGS在联合参数估计与部件网格重建上达到当前最优表现。该方法显著提升了重建质量与效率,尤其适用于多部件可动物体。我们还对设计选择进行了全面分析,验证了各组件的有效性,指明未来改进方向。项目代码已公开:https://articulate-gs.github.io。

原文摘要 · Abstract (English)

Building articulated objects is a key challenge in computer vision. Existing methods often fail to effectively integrate information across different object states, limiting the accuracy of part-mesh reconstruction and part dynamics modeling, particularly for complex multi-part articulated objects. We introduce ArtGS, a novel approach that leverages 3D Gaussians as a flexible and efficient representation to address these issues. Our method incorporates canonical Gaussians with coarse-to-fine initialization and updates for aligning articulated part information across different object states, and employs a skinning-inspired part dynamics modeling module to improve both part-mesh reconstruction and articulation learning. Extensive experiments on both synthetic and real-world datasets, including a new benchmark for complex multi-part objects, demonstrate that ArtGS achieves state-of-the-art performance in joint parameter estimation and part mesh reconstruction. Our approach significantly improves reconstruction quality and efficiency, especially for multi-part articulated objects. Additionally, we provide comprehensive analyses of our design choices, validating the effectiveness of each component to highlight potential areas for future improvement. Our work is made publicly available at: https://articulate-gs.github.io.

3D重建高斯点云可动物体网格建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。