一个模型搞定任意骨骼的文本驱动动画,无需微调或重训练。
UniMate: One Unified Model to Animate Diverse Skeletons

- 用拓扑感知扩散变换器统一建模不同骨骼结构
- 在1.3万条动作数据上训练,支持零样本跨类型迁移
- 适合需要快速生成多样动画的创作者和游戏开发者
当前自动绑定技术可规模化生成可动画化的3D资产,但生成驱动动作仍是瓶颈。现有学习型动画模型受拓扑限制:依赖类别特定模板或需针对每个骨骼在推理时微调及参考动作。我们提出UniMate,一种统一基础模型,仅需一个带绑定的3D资产和文本提示,即可合成任意骨骼的关节动作,无需测试时优化或逐骨骼重训练。UniMate引入拓扑感知扩散变换器,通过三种机制将骨骼拓扑融入注意力:(1) 基于关节约对关系与测地距离的图感知注意力偏置;(2) 通过图拉普拉斯矩阵泛化RoPE至任意运动树的谱旋转位置编码;(3) 从静止姿态骨骼全局聚合的拓扑条件注意力。我们还构建了UniML3D数据集,包含13,006条涵盖双足、四足、鸟类、海洋生物、昆虫、蛇形及刚体类的运动序列,具有统一规范与文本标注。在该数据集上训练后,UniMate在质量、泛化性与效率上均超越现有最优基线,支持零样本跨拓扑迁移、补间、扩展及文本引导编辑。
原文摘要 · Abstract (English)
Recent advances in automatic rigging now deliver animation-ready 3D assets at scale, yet generating the motion to drive them remains a bottleneck. Existing learned animators are topology-constrained: they rely on category-specific templates or require per-skeleton fine-tuning and reference motions at inference. We present UniMate, a unified foundation model that synthesizes articulated motion for arbitrary skeletons from a rigged 3D asset and a text prompt, with no test-time optimization or per-skeleton retraining. UniMate introduces a topology-aware diffusion transformer, which integrates skeletal topology into attention via three mechanisms: (1) a graph-aware attention bias from pairwise joint relations and geodesic distances; (2) a spectral rotary position embedding generalizing RoPE to arbitrary kinematic trees via the graph Laplacian; and (3) a global topological conditioner attention-pooled from the rest-pose skeleton. We also curate UniML3D, 13,006 motion sequences spanning bipedal, quadrupedal, avian, marine, insectoid, serpentine, and articulated rigid objects with unified canonicalization and text pairing. Trained on this dataset, UniMate outperforms state-of-the-art baselines in quality, generalization, and efficiency, and supports zero-shot cross-topology transfer, in-betweening, expansion, and text-guided editing. Our project page is available at https://linzhanmou.com/unimate/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。