让两个角色自然互动地生成连贯动作,支持长时间动态交互。
Motion In-Betweening for Densely Interacting Characters
- 通过跨空间插值建模角色间动态交互关系。
- 实现多关键帧下长达数秒的自然动作过渡,交互质量稳定。
- 适合动画师、游戏开发人员用于复杂角色互动生成。
运动插值是生成关键姿态之间运动的过程。传统研究主要针对单一角色,扩展到密集交互角色极具挑战性,需在保持角色间精确时空对应的同时,自然过渡至预设关键姿态。本文提出一种长时序交互插值方法,使两名角色能自然地相互作用与响应。为有效表示和合成交互,我们引入新的交叉空间插值机制,建模每个角色在不同条件表示空间中的交互。我们发现,交互角色的约束显著增加,导致解空间受限,运动质量下降且交互随时间减弱。为此,我们提出两项策略:首先通过对抗学习识别周期性交互模式以维持交互质量;其次学习修正漂移的潜在空间,防止姿态误差累积。实验表明,该方法可在多个关键姿态间生成真实、可控且长达数秒的交互动作,涵盖动态拳击与舞蹈场景,经大量定量评估与用户研究验证效果优越。
原文摘要 · Abstract (English)
Motion in-betweening is the problem to synthesize movement between keyposes. Traditional research focused primarily on single characters. Extending them to densely interacting characters is highly challenging, as it demands precise spatial-temporal correspondence between the characters to maintain the interaction, while creating natural transitions towards predefined keyposes. In this research, we present a method for long-horizon interaction in-betweening that enables two characters to engage and respond to one another naturally. To effectively represent and synthesize interactions, we propose a novel solution called Cross-Space In-Betweening, which models the interactions of each character across different conditioning representation spaces. We further observe that the significantly increased constraints in interacting characters heavily limit the solution space, leading to degraded motion quality and diminished interaction over time. To enable long-horizon synthesis, we present two solutions to maintain long-term interaction and motion quality, thereby keeping synthesis in the stable region of the solution space.We first sustain interaction quality by identifying periodic interaction patterns through adversarial learning. We further maintain the motion quality by learning to refine the drifted latent space and prevent pose error accumulation. We demonstrate that our approach produces realistic, controllable, and long-horizon in-between motions of two characters with dynamic boxing and dancing actions across multiple keyposes, supported by extensive quantitative evaluations and user studies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。