用可学习的离散贴纸表示皮肤权重,统一生成骨骼与绑定关系。
Skin Tokens: A Learned Compact Representation for Unified Autoregressive Rigging
- 提出SkinTokens,将皮肤权重转为紧凑离散表示,解决高维回归难题。
- 相比现有方法,皮肤绑定精度提升98%-133%,骨骼预测准确率提高17%-22%。
- 适合需要自动化3D角色绑定的动画师和游戏开发者使用。
生成式3D模型的快速发展带来了动画流程中的关键瓶颈:绑定(rigging)。现有自动化方法受限于对皮肤绑定的处理方式,将其视为病态的高维回归任务,优化效率低且常与骨骼生成脱钩。我们认为这是表征问题,提出SkinTokens:一种学习得到的、紧凑的、离散的皮肤权重表示。通过使用FSQ-CVAE捕捉皮肤绑定的内在稀疏性,将任务从连续回归重构为更易处理的标记序列预测问题。该表示支持TokenRig——一个统一的自回归框架,将整个绑定过程建模为骨骼参数与SkinTokens的单一序列,学习骨骼与形变间的复杂依赖关系。该统一模型可进一步引入强化学习阶段,通过定制化的几何与语义奖励提升对复杂、分布外资产的泛化能力。定量结果表明,SkinTokens表示使皮肤绑定精度相较最先进方法提升98%-133%;经强化学习优化的完整TokenRig框架,骨骼预测性能提升17%-22%。本工作提供了一种统一的生成式绑定方案,显著提升保真度与鲁棒性,为长期存在的3D内容创作挑战提供了可扩展解决方案。
原文摘要 · Abstract (English)
The rapid proliferation of generative 3D models has created a critical bottleneck in animation pipelines: rigging. Existing automated methods are fundamentally limited by their approach to skinning, treating it as an ill-posed, high-dimensional regression task that is inefficient to optimize and is typically decoupled from skeleton generation. We posit this is a representation problem and introduce SkinTokens: a learned, compact, and discrete representation for skinning weights. By leveraging an FSQ-CVAE to capture the intrinsic sparsity of skinning, we reframe the task from continuous regression to a more tractable token sequence prediction problem. This representation enables TokenRig, a unified autoregressive framework that models the entire rig as a single sequence of skeletal parameters and SkinTokens, learning the complicated dependencies between skeletons and skin deformations. The unified model is then amenable to a reinforcement learning stage, where tailored geometric and semantic rewards improve generalization to complex, out-of-distribution assets. Quantitatively, the SkinTokens representation leads to a 98%-133% percents improvement in skinning accuracy over state-of-the-art methods, while the full TokenRig framework, refined with RL, enhances bone prediction by 17%-22%. Our work presents a unified, generative approach to rigging that yields higher fidelity and robustness, offering a scalable solution to a long-standing challenge in 3D content creation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。