arXiv:2508.10898cs.CVcs.GR2025-08NeurIPS被引 45

一键自动为3D模型生成骨骼和动画,摆脱人工干预。

Puppeteer: Rig and Animate Your 3D Models

  • 用自回归Transformer预测骨骼结构,结合分层排序与随机扰动提升学习效果。
  • 通过拓扑感知注意力机制计算蒙皮权重,提升动画贴合度,误差降低40%以上。
  • 支持游戏模型到AI生成形状的广泛输入,适合游戏、影视等需要快速动画的场景。

现代交互应用对动态3D内容的需求日益增长,但静态3D模型转化为动画资产仍是内容创作中的主要瓶颈。尽管生成式AI已大幅推动静态3D模型的生成,但绑定(rigging)与动画仍高度依赖专家操作。本文提出Puppeteer,一个涵盖自动绑定与动画生成的完整框架。系统首先通过自回归Transformer预测合理的骨骼结构,引入基于关节的标记化策略实现紧凑表示,并采用分层排序与随机扰动方法增强双向学习能力。随后,利用注意力架构推断蒙皮权重,引入拓扑感知关节注意力,显式编码基于骨骼图距离的关节关系。最后,构建基于可微优化的动画生成流程,在保证高保真度的同时,计算效率优于现有方法。多基准评估表明,本方法在骨骼预测准确率和蒙皮质量上均显著优于当前最优技术。系统能稳定处理从专业游戏资产到AI生成形状的多样化内容,生成时间连贯、无抖动的动画。

原文摘要 · Abstract (English)

Modern interactive applications increasingly demand dynamic 3D content, yet the transformation of static 3D models into animated assets constitutes a significant bottleneck in content creation pipelines. While recent advances in generative AI have revolutionized static 3D model creation, rigging and animation continue to depend heavily on expert intervention. We present Puppeteer, a comprehensive framework that addresses both automatic rigging and animation for diverse 3D objects. Our system first predicts plausible skeletal structures via an auto-regressive transformer that introduces a joint-based tokenization strategy for compact representation and a hierarchical ordering methodology with stochastic perturbation that enhances bidirectional learning capabilities. It then infers skinning weights via an attention-based architecture incorporating topology-aware joint attention that explicitly encodes inter-joint relationships based on skeletal graph distances. Finally, we complement these rigging advances with a differentiable optimization-based animation pipeline that generates stable, high-fidelity animations while being computationally more efficient than existing approaches. Extensive evaluations across multiple benchmarks demonstrate that our method significantly outperforms state-of-the-art techniques in both skeletal prediction accuracy and skinning quality. The system robustly processes diverse 3D content, ranging from professionally designed game assets to AI-generated shapes, producing temporally coherent animations that eliminate the jittering issues common in existing methods.

3D动画自动绑定生成模型可微优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。