arXiv:2510.25765cs.CVcs.GR2025-10SIGGRAPH被引 25

无需训练,仅用几张图就能生成带关节的高精度3D模型。

FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusion

  • 复用预训练静态3D扩散模型,将关节运动作为额外生成维度。
  • 仅需几幅不同姿态的图像,即可优化出几何、纹理和关节参数。
  • 生成速度快、质量高,适合机器人、VR/AR等多场景应用。

关节式3D物体在机器人、增强现实、虚拟现实及动画中至关重要。现有方法或依赖密集视角监督的优化重建流程,或使用前馈生成模型,但常产生粗糙几何并忽略表面纹理。尽管静态3D物体的开放世界生成已取得显著进展,尤其得益于原生3D扩散模型(如Trellis),但直接训练原生3D扩散模型来生成关节物体仍面临巨大挑战。本文提出FreeArt3D,一种无需训练的关节式3D物体生成框架。不需在有限的关节数据上训练新模型,FreeArt3D复用预训练的静态3D扩散模型(如Trellis)作为强大的形状先验。通过将得分蒸馏采样(SDS)扩展至3D到4D域,将关节运动视为额外生成维度。仅需若干张不同关节状态下的图像,即可联合优化物体的几何、纹理与关节参数,无需任务特定训练或大规模关节数据集。本方法生成高质量几何与纹理,准确预测底层运动结构,并在多种物体类别上表现出良好泛化能力。尽管采用每实例优化范式,FreeArt3D可在分钟级完成,且在质量和通用性上显著优于现有最先进方法。

原文摘要 · Abstract (English)

Articulated 3D objects are central to many applications in robotics, AR/VR, and animation. Recent approaches to modeling such objects either rely on optimization-based reconstruction pipelines that require dense-view supervision or on feed-forward generative models that produce coarse geometric approximations and often overlook surface texture. In contrast, open-world 3D generation of static objects has achieved remarkable success, especially with the advent of native 3D diffusion models such as Trellis. However, extending these methods to articulated objects by training native 3D diffusion models poses significant challenges. In this work, we present FreeArt3D, a training-free framework for articulated 3D object generation. Instead of training a new model on limited articulated data, FreeArt3D repurposes a pre-trained static 3D diffusion model (e.g., Trellis) as a powerful shape prior. It extends Score Distillation Sampling (SDS) into the 3D-to-4D domain by treating articulation as an additional generative dimension. Given a few images captured in different articulation states, FreeArt3D jointly optimizes the object's geometry, texture, and articulation parameters without requiring task-specific training or access to large-scale articulated datasets. Our method generates high-fidelity geometry and textures, accurately predicts underlying kinematic structures, and generalizes well across diverse object categories. Despite following a per-instance optimization paradigm, FreeArt3D completes in minutes and significantly outperforms prior state-of-the-art approaches in both quality and versatility. Please check our website for more details: https://czzzzh.github.io/FreeArt3D

3D生成扩散模型关节物体零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。