arXiv:2503.06677cs.CVcs.MM2025-03NeurIPS被引 29

用几何与运动约束提升可动物体3D高保真重建与生成效果

REArtGS: Reconstructing and Generating Articulated Objects via 3D Gaussian Splatting with Geometric and Motion Constraints

  • 在3D高斯中加入几何与运动约束,增强表面重建精度
  • 仅需两组视角图像,即可实现未见状态的高质量表面生成
  • 适合需要高保真可动物体建模的研究者或工业应用

可动物体在人类生活中广泛存在,其三维表示在众多应用中至关重要。然而,现有方法难以同时实现高保真纹理表面重建与动态生成。本文提出REArtGS框架,在3D高斯原语中引入额外的几何与运动约束,实现可动物体的真实感表面重建与生成。给定任意两个状态的多视角RGB图像,首先采用无偏符号距离场(SDF)引导正则化高斯不透明度场,强化几何约束并提升表面重建质量;随后建立受可动结构约束的可变形场,实现对未见状态表面网格的无监督生成。在合成与真实数据集上的大量实验表明,该方法不仅能实现给定状态的高质量纹理表面重建,还可生成未见状态的高保真表面。项目主页:https://sites.google.com/view/reartgs/home。

原文摘要 · Abstract (English)

Articulated objects, as prevalent entities in human life, their 3D representations play crucial roles across various applications. However, achieving both high-fidelity textured surface reconstruction and dynamic generation for articulated objects remains challenging for existing methods. In this paper, we present REArtGS, a novel framework that introduces additional geometric and motion constraints to 3D Gaussian primitives, enabling realistic surface reconstruction and generation for articulated objects. Specifically, given multi-view RGB images of arbitrary two states of articulated objects, we first introduce an unbiased Signed Distance Field (SDF) guidance to regularize Gaussian opacity fields, enhancing geometry constraints and improving surface reconstruction quality. Then we establish deformable fields for 3D Gaussians constrained by the kinematic structures of articulated objects, achieving unsupervised generation of surface meshes in unseen states. Extensive experiments on both synthetic and real datasets demonstrate our approach achieves high-quality textured surface reconstruction for given states, and enables high-fidelity surface generation for unseen states. Project site: https://sites.google.com/view/reartgs/home.

3D重建高斯溅射可动物体生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。