arXiv:2607.02148cs.CV2026-07

跨骨骼类型统一建模动作,让不同动物肢体动作可互换生成。

SAMoR: Motion Modelling for Articulated Objects of Any Skeleton and Topology

论文配图:SAMoR: Motion Modelling for Articulated Objects of Any Skeleton and Topology
图 1 · 摘自论文原文
  • 用8个共享部件令牌表示任意骨架的动作,通过图注意力压缩关节特征。
  • 跨骨架重建误差仅0.0275,比最强基线低5.8倍,且支持文本生成与局部编辑。
  • 适用于动物、角色等异构骨架,尤其适合需要动作迁移的动画场景。

对任意骨骼拓扑的关节物体动作建模仍具挑战:现有生成器多针对固定人体骨架,此前方法要么无法在不同骨架间共享动作词汇,要么通过全局池化丢失细节。关键观察是:尽管关节级动作在不同物种间不对应,但功能关节组的运动结构一致——人类手臂、狼前腿和鸟翅膀虽关节数与连接方式不同,但运动模式相似,关节名(如“forearm”、“wing_L1”)部分揭示了这种共性。本文提出SAMoR(Skeleton-Aware Motion Representation),一种跨拓扑动作表示,将每个动作片段编码为固定的8个部件令牌(K=8),可在任意骨架间共享。图变压器编码器融合关节运动特征、运动学图结构与关节名嵌入,通过交叉注意力池化与残差向量量化,生成跨骨架共享的离散动作码本。为防止部件查询退化为冗余全局表示,引入拓扑无关注意力监督损失,并使用关节名丢弃机制减少对文本标签的依赖。构建包含HumanML3D、Truebones Zoo及动画Objaverse-XL资产的异质语料库,在未见骨架角色上评估。SAMoR实现高精度重建与跨拓扑迁移,支持文本条件生成与部件级编辑,跨拓扑重建归一化MPJPE达2.75×10⁻²,优于最强适配的变关节数分词器基线5.8倍,且在HumanML3D上与固定骨架专家模型相当。

原文摘要 · Abstract (English)

Modeling motion for articulated objects of arbitrary skeleton topology remains difficult: existing motion generators target a fixed human skeleton, and prior adaptations either fail to share a vocabulary across rigs or discard motion detail through global pooling. Our key observation is that while joint-level motion does not correspond cleanly across species, motion of functional joint groups does: a human arm, a wolf foreleg, and a bird wing share motion structure despite differing joint counts and connectivity, a correspondence that joint names (e.g., "forearm", "wing_L1") partially expose even when topology does not. We introduce SAMoR (Skeleton-Aware Motion Representation for Articulated Objects), a cross-topology motion representation that encodes each motion segment as a small fixed number ($K=8$) of part tokens shared across arbitrary skeletons. A graph-transformer encoder consumes per-joint motion features, kinematic graph structure, and joint-name embeddings, then compresses them into part-level tokens via cross-attention pooling and residual vector quantization, yielding a discrete motion codebook shared across rigs. To keep the part queries from collapsing into redundant global representations, we introduce a topology-agnostic attention supervision loss, with joint-name dropout to reduce over-reliance on text labels. We curate a heterogeneous corpus from HumanML3D, Truebones Zoo, and animated Objaverse-XL assets, and evaluate SAMoR on held-out characters with unseen skeletons. It supports accurate reconstruction and cross-topology transfer, and enables text-conditioned generation and part-wise editing via a MaskGIT token generator. SAMoR reaches $2.75 \times 10^{-2}$ normalized MPJPE on cross-topology reconstruction, $5.8\times$ below the strongest adapted variable-$J$ tokenizer baseline, while remaining competitive with fixed-skeleton specialists on HumanML3D.

动作生成跨骨架图神经网络动画迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。