arXiv:2503.20663cs.CV2025-03ICCV被引 8

用自回归模型统一生成3D物体骨骼位置与连接关系,提升动画生成质量。

ARMO: Autoregressive Rigging for Multi-Category Objects

  • 将骨骼结构建模为完整图并分词,用自回归模型逐个预测
  • 在7.9万样本的OmniRig数据集上实现最佳骨骼预测性能
  • 适合做3D角色动画、虚拟人、游戏资产生成的研究者

大规模生成模型虽显著提升了3D形状生成的质量与多样性,但多数方法仅关注静态3D模型,忽视了人形、动物等物体潜在的动态特性。为此,本文聚焦于动画中的基础任务——骨骼绑定,即建立3D模型的骨架结构与皮肤权重。提出首个大规模骨骼绑定数据集OmniRig,包含79,499个带详细骨架和皮肤信息的网格模型。不同于依赖标准姿态(如A-pose)的传统基准,该数据集涵盖多样类别、风格与姿态。基于此,提出ARMO框架,采用自回归模型统一预测关节位置与连接关系。通过将骨骼结构视为完整图并离散化为令牌,利用自编码器获取关节的隐式嵌入,并以网格条件隐扩散模型生成条件嵌入。相比传统回归方法易积累误差且连接估计不佳的问题,本方法显著提升跨类别泛化能力。在OmniRig数据集上的实验表明,该方法在骨架预测任务中达到当前最优表现。代码与数据集将在论文录用后公开。

原文摘要 · Abstract (English)

Recent advancements in large-scale generative models have significantly improved the quality and diversity of 3D shape generation. However, most existing methods focus primarily on generating static 3D models, overlooking the potentially dynamic nature of certain shapes, such as humanoids, animals, and insects. To address this gap, we focus on rigging, a fundamental task in animation that establishes skeletal structures and skinning for 3D models. In this paper, we introduce OmniRig, the first large-scale rigging dataset, comprising 79,499 meshes with detailed skeleton and skinning information. Unlike traditional benchmarks that rely on predefined standard poses (e.g., A-pose, T-pose), our dataset embraces diverse shape categories, styles, and poses. Leveraging this rich dataset, we propose ARMO, a novel rigging framework that utilizes an autoregressive model to predict both joint positions and connectivity relationships in a unified manner. By treating the skeletal structure as a complete graph and discretizing it into tokens, we encode the joints using an auto-encoder to obtain a latent embedding and an autoregressive model to predict the tokens. A mesh-conditioned latent diffusion model is used to predict the latent embedding for conditional skeleton generation. Our method addresses the limitations of regression-based approaches, which often suffer from error accumulation and suboptimal connectivity estimation. Through extensive experiments on the OmniRig dataset, our approach achieves state-of-the-art performance in skeleton prediction, demonstrating improved generalization across diverse object categories. The code and dataset will be made public for academic use upon acceptance.

3D生成骨骼绑定自回归模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。