arXiv:2603.22102cs.CVcs.GR2026-03中稿 · CVPR被引 1

仅用单目视频就能重建自由运动的关节物体,效果出色且通用性强。

FreeArtGS: Articulated Gaussian Splatting Under Free-moving Scenario

  • 通过相对运动识别刚性部件,实现自由移动场景下的部件分割。
  • 联合估计相机位姿与关节参数,无需预先对齐轴线。
  • 端到端优化纹理、几何与关节角度,支持真实场景资产生成。

增强现实与机器人领域对高可扩展性的关节物体重建需求日益增长。现有方法依赖离散关节状态或随意拍摄的单目视频,要么需要复杂的轴线对齐,要么覆盖不足,应用受限。本文提出FreeArtGS,一种在自由移动场景下重建关节物体的新方法,只需输入单目RGB-D视频,设置简单且可扩展性强。该方法结合自由移动部件分割与联合估计,利用现成点跟踪和特征模型先验,从无约束采集中通过相对运动识别刚性部分;联合估计模块鲁棒地校准统一的物-相机位姿,并恢复关节类型与轴线;最后基于3DGS的端到端优化,联合重建视觉纹理、几何结构及关节角度。在两个基准数据集和真实关节物体上进行实验,结果表明FreeArtGS在自由移动场景中持续表现优异,在以往设置下也保持高度竞争力,证明其为真实场景资产生成的实用高效方案。

原文摘要 · Abstract (English)

The increasing demand for augmented reality and robotics is driving the need for articulated object reconstruction with high scalability. However, existing settings for reconstructing from discrete articulation states or casual monocular videos require non-trivial axis alignment or suffer from insufficient coverage, limiting their applicability. In this paper, we introduce FreeArtGS, a novel method for reconstructing articulated objects under free-moving scenario, a new setting with a simple setup and high scalability. FreeArtGS combines free-moving part segmentation with joint estimation and end-to-end optimization, taking only a monocular RGB-D video as input. By optimizing with the priors from off-the-shelf point-tracking and feature models, the free-moving part segmentation module identifies rigid parts from relative motion under unconstrained capture. The joint estimation module calibrates the unified object-to-camera poses and recovers joint type and axis robustly from part segmentation. Finally, 3DGS-based end-to-end optimization is implemented to jointly reconstruct visual textures, geometry, and joint angles of the articulated object. We conduct experiments on two benchmarks and real-world free-moving articulated objects. Experimental results demonstrate that FreeArtGS consistently excels in reconstructing free-moving articulated objects and remains highly competitive in previous reconstruction settings, proving itself a practical and effective solution for realistic asset generation. The project page is available at: https://freeartgs.github.io/

关节重建3DGS单目视频增强现实

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。