arXiv:2506.09663cs.CV2025-06中稿 · ICLR被引 3

用高斯点云实现可连续变形的关节物体建模,无需人工标注。

PD$^{2}$GS: Part-Level Decoupling and Continuous Deformation of Articulated Objects via Gaussian Splatting

  • 通过共享高斯场加隐变量控制,将关节状态建模为连续形变。
  • 在合成与真实数据上均超越现有方法的几何与运动精度。
  • 适合机器人、AR/VR中需要精细控制的关节物体重建场景。

关节物体在机器人、增强现实/虚拟现实及数字孪生中广泛存在。现有自监督方法通常重建离散交互状态并依赖跨状态几何一致性,导致表征碎片化和漂移,影响关节配置的平滑控制。本文提出PD²GS框架,学习一个共享的规范高斯场,并将任意交互状态建模为该场的连续形变,联合编码几何与运动信息。通过为每个状态关联隐变量,并利用通用视觉先验优化部件边界,PD²GS实现精确可靠的部件级解耦,确保部件间互斥性并保持场景一致性。该统一框架支持部件感知重建、细粒度连续控制与精准运动建模,全程无需人工标注。为评估真实感与泛化能力,我们发布RS-Art数据集,包含对齐逆向工程3D模型的真实世界RGB-D数据,支持真实场景评估。大量实验表明,PD²GS在合成与真实数据上均显著优于先前方法,在几何与运动准确性及连续控制一致性方面表现更优。

原文摘要 · Abstract (English)

Articulated objects are ubiquitous and important in robotics, AR/VR, and digital twins. Most self-supervised methods for articulated object modeling reconstruct discrete interaction states and relate them via cross-state geometric consistency, yielding representational fragmentation and drift that hinder smooth control of articulated configurations. We introduce PD$^{2}$GS, a novel framework that learns a shared canonical Gaussian field and models the arbitrary interaction state as its continuous deformation, jointly encoding geometry and kinematics. By associating each interaction state with a latent code and refining part boundaries using generic vision priors, PD$^{2}$GS enables accurate and reliable part-level decoupling while enforcing mutual exclusivity between parts and preserving scene-level coherence. This unified formulation supports part-aware reconstruction, fine-grained continuous control, and accurate kinematic modeling, all without manual supervision. To assess realism and generalization, we release RS-Art, a real-to-sim RGB-D dataset aligned with reverse-engineered 3D models, supporting real-world evaluation. Extensive experiments demonstrate that PD$^{2}$GS surpasses prior methods in geometric and kinematic accuracy, and in consistency under continuous control, both on synthetic and real data.

关节物体高斯溅射连续控制自监督建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。