解决动作重定向中的穿模与抖动问题,实现更自然的跨体型动作迁移。
STaR: Seamless Spatial-Temporal Aware Motion Retargeting with Penetration and Consistency Constraints
- 分空间与时间双模块,分别约束肢体穿模和运动连贯性。
- 在Mixamo和ScanRet数据集上穿模率显著降低,动作更流畅稳定。
- 适合需要高保真角色动画的影视游戏制作场景。
动作重定向旨在将源角色的时空运动特征忠实地迁移到体型不同的目标角色上。除了保持动作语义外,几何合理性与时间一致性对有效重定向同样关键。然而,现有方法常偏向几何合理性或时间一致性之一。忽略几何合理性会导致肢体穿模,忽略时间一致性则引发动作抖动。本文提出一种新型序列到序列模型——无缝时空感知动作重定向(STaR),包含穿透与一致性约束。STaR由两个模块构成:(1) 空间模块,结合密集形状表示与新颖的肢体穿模约束,确保几何合理性并保留动作语义;(2) 时间模块,利用时间变压器与新颖的时间一致性约束,一次性预测完整运动序列,并强制多层级轨迹平滑。双模块无缝融合使语义、几何与时间目标达到良好平衡。在Mixamo和ScanRet数据集上的大量实验表明,该方法生成的动作既合理又连贯,相比其他方法显著降低穿模率。
原文摘要 · Abstract (English)
Motion retargeting seeks to faithfully replicate the spatio-temporal motion characteristics of a source character onto a target character with a different body shape. Apart from motion semantics preservation, ensuring geometric plausibility and maintaining temporal consistency are also crucial for effective motion retargeting. However, many existing methods prioritize either geometric plausibility or temporal consistency. Neglecting geometric plausibility results in interpenetration while neglecting temporal consistency leads to motion jitter. In this paper, we propose a novel sequence-to-sequence model for seamless Spatial-Temporal aware motion Retargeting (STaR), with penetration and consistency constraints. STaR consists of two modules: (1) a spatial module that incorporates dense shape representation and a novel limb penetration constraint to ensure geometric plausibility while preserving motion semantics, and (2) a temporal module that utilizes a temporal transformer and a novel temporal consistency constraint to predict the entire motion sequence at once while enforcing multi-level trajectory smoothness. The seamless combination of the two modules helps us achieve a good balance between the semantic, geometric, and temporal targets. Extensive experiments on the Mixamo and ScanRet datasets demonstrate that our method produces plausible and coherent motions while significantly reducing interpenetration rates compared with other approaches. Code page: https://github.com/XiaohangYang829/STaR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。