直接建模角色身体部件间密集几何交互,避免穿模与动作失真。
Skinned Motion Retargeting with Dense Geometric Interaction Perception
- 用语义一致传感器建立跨拓扑网格的密集对应关系。
- 提出时空密集交互场,同时捕捉接触与非接触交互关系。
- 在Mixamo和自建ScanRet数据集上表现领先,适合高保真动画迁移。
在皮肤化角色的动作重定向中,保持不同身体部位间的几何交互至关重要。现有方法常忽略身体几何或在骨骼动作重定向后添加几何修正阶段,导致骨架交互与几何修正冲突,引发抖动、穿模和接触错位等问题。为此,我们提出新框架MeshRet,直接在动作重定向中建模密集几何交互。首先,通过语义一致传感器(SCS)在不同网格拓扑间建立密集网格对应关系;随后,提出一种新型时空表示——密集网格交互(DMI)场,该场由相互作用的SCS特征向量构成,能精细捕捉身体几何间的接触与非接触交互。通过在重定向过程中对齐DMI场,MeshRet不仅保留动作语义,还有效防止自穿模并确保接触一致性。在公开Mixamo数据集及自建ScanRet数据集上的大量实验表明,MeshRet达到当前最优性能。代码已开源:https://github.com/abcyzj/MeshRet。
原文摘要 · Abstract (English)
Capturing and maintaining geometric interactions among different body parts is crucial for successful motion retargeting in skinned characters. Existing approaches often overlook body geometries or add a geometry correction stage after skeletal motion retargeting. This results in conflicts between skeleton interaction and geometry correction, leading to issues such as jittery, interpenetration, and contact mismatches. To address these challenges, we introduce a new retargeting framework, MeshRet, which directly models the dense geometric interactions in motion retargeting. Initially, we establish dense mesh correspondences between characters using semantically consistent sensors (SCS), effective across diverse mesh topologies. Subsequently, we develop a novel spatio-temporal representation called the dense mesh interaction (DMI) field. This field, a collection of interacting SCS feature vectors, skillfully captures both contact and non-contact interactions between body geometries. By aligning the DMI field during retargeting, MeshRet not only preserves motion semantics but also prevents self-interpenetration and ensures contact preservation. Extensive experiments on the public Mixamo dataset and our newly-collected ScanRet dataset demonstrate that MeshRet achieves state-of-the-art performance. Code available at https://github.com/abcyzj/MeshRet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。