arXiv:2503.15586cs.GRcs.CV2025-03中稿 · Eurographics 2025

用少量帧自动为异构角色生成可动骨骼,支持真人与卡通风格。

How to Train Your Dragon: Automatic Diffusion-Based Rigging for Characters with Diverse Topologies

  • 基于少量示例帧和骨架信息,快速推断角色绑定结构。
  • 在3-5帧条件下实现新姿态的高质量图像生成,支持多样拓扑。
  • 首个含关键点标注的2D非人形角色视频数据集,适合动画研究者。

近期基于扩散模型的方法在人物图像动画化上取得显著进展,但大多依赖人体特化的姿态表示和大量带标签的真实视频训练。本文将此类模型能力拓展至具有多样化骨骼拓扑的角色动画。仅需3-5个展示角色不同姿态并附有骨架信息的示例帧,我们的模型即可快速推断出该角色的绑定结构,并生成对应新骨架姿态的图像。我们提出一种过程式数据生成流程,可实时高效采样具有多样化拓扑的训练数据。结合新型骨架表示,在涵盖广泛纹理与拓扑的刚性形体上进行训练。微调阶段,模型能快速适应未见目标角色,且在真实与卡通风格下均能良好泛化生成新姿态。为更准确评估此新挑战任务,我们构建了首个包含人类及非人类主体、每帧带关键点标注的2D视频数据集。大量实验表明,本方法生成结果质量显著优于现有方案。

原文摘要 · Abstract (English)

Recent diffusion-based methods have achieved impressive results on animating images of human subjects. However, most of that success has built on human-specific body pose representations and extensive training with labeled real videos. In this work, we extend the ability of such models to animate images of characters with more diverse skeletal topologies. Given a small number (3-5) of example frames showing the character in different poses with corresponding skeletal information, our model quickly infers a rig for that character that can generate images corresponding to new skeleton poses. We propose a procedural data generation pipeline that efficiently samples training data with diverse topologies on the fly. We use it, along with a novel skeleton representation, to train our model on articulated shapes spanning a large space of textures and topologies. Then during fine-tuning, our model rapidly adapts to unseen target characters and generalizes well to rendering new poses, both for realistic and more stylized cartoon appearances. To better evaluate performance on this novel and challenging task, we create the first 2D video dataset that contains both humanoid and non-humanoid subjects with per-frame keypoint annotations. With extensive experiments, we demonstrate the superior quality of our results. Project page: https://traindragondiffusion.github.io/

角色动画扩散模型骨骼绑定2D生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。