无需结构匹配,跨类3D角色姿态迁移新方法
MimiCAT: Mimic with Correspondence-Aware Cascade-Transformer for Category-Free 3D Pose Transfer
- 用语义关键点构建软对应关系,实现多对多匹配
- 在百万级数据上训练,支持任意角色间姿态迁移
- 适合动画制作、游戏开发等跨类型角色生成场景
3D姿态迁移旨在将源网格的姿态风格迁移到目标角色,同时保持目标的几何形状和源的姿态特征。现有方法大多局限于结构相似的角色,难以推广到无类别限制的场景(如将人形角色姿态迁移到四足角色)。核心挑战在于不同角色类型间存在的结构与变换多样性,常导致区域错位和迁移质量下降。为此,我们构建了一个涵盖数百种不同角色的百万级姿态数据集。进一步提出MimiCAT,一种面向无类别3D姿态迁移的级联变压器模型。该模型不依赖严格的单对单对应映射,而是利用语义关键点标签学习一种新型软对应关系,实现角色间的灵活多对多匹配。姿态迁移被建模为条件生成过程:先通过软对应匹配将源变换投影到目标,再利用形状条件表示进行精细化调整。大量定性与定量实验表明,MimiCAT能在多种角色形态间生成合理姿态,显著优于仅限窄类别迁移(如人形到人形)的现有方法。
原文摘要 · Abstract (English)
3D pose transfer aims to transfer the pose-style of a source mesh to a target character while preserving both the target's geometry and the source's pose characteristic. Existing methods are largely restricted to characters with similar structures and fail to generalize to category-free settings (e.g., transferring a humanoid's pose to a quadruped). The key challenge lies in the structural and transformation diversity inherent in distinct character types, which often leads to mismatched regions and poor transfer quality. To address these issues, we first construct a million-scale pose dataset across hundreds of distinct characters. We further propose MimiCAT, a cascade-transformer model designed for category-free 3D pose transfer. Instead of relying on strict one-to-one correspondence mappings, MimiCAT leverages semantic keypoint labels to learn a novel soft correspondence that enables flexible many-to-many matching across characters. The pose transfer is then formulated as a conditional generation process, in which the source transformations are first projected onto the target through soft correspondence matching and subsequently refined using shape-conditioned representations. Extensive qualitative and quantitative experiments demonstrate that MimiCAT generalizes plausible poses across diverse character morphologies, surpassing prior approaches restricted to narrow-category transfer (e.g., humanoid-to-humanoid).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。