提出新方法生成多人密集互动动画,支持角色间自然协作与动态换伴。
Large-Scale Multi-Character Interaction Synthesis
- 构建可协调的多角色动作空间与过渡规划网络
- 在真实场景中实现多人密集互动的自然过渡与协同
- 适合动画制作、虚拟演出等需要复杂角色交互的场景
大规模多角色互动生成是角色动画中的关键挑战。此类互动不仅包含自然的动作交互,还需角色在空间和时间上协调完成换伴等过渡。例如舞蹈场景中,角色需与当前舞伴配合,并根据周围环境变化与新伙伴建立连接。我们称这类过程为协调性互动,将其分解为互动生成与过渡规划两部分。现有单角色动画方法忽视多角色互动;基于深度学习的方法通常仅处理两人互动,缺乏过渡规划;优化方法依赖人工设计目标函数,泛化能力差;群体模拟虽有多个角色,但互动稀疏且被动。现有数据集或缺乏多角色,或无紧密密集互动。为此,我们提出一种条件生成框架:包含可协调的多角色互动空间用于动作生成,以及过渡规划网络实现角色间的协调。实验表明该方法在多角色互动合成中有效,且具备良好的可扩展性与迁移能力。
原文摘要 · Abstract (English)
Generating large-scale multi-character interactions is a challenging and important task in character animation. Multi-character interactions involve not only natural interactive motions but also characters coordinated with each other for transition. For example, a dance scenario involves characters dancing with partners and also characters coordinated to new partners based on spatial and temporal observations. We term such transitions as coordinated interactions and decompose them into interaction synthesis and transition planning. Previous methods of single-character animation do not consider interactions that are critical for multiple characters. Deep-learning-based interaction synthesis usually focuses on two characters and does not consider transition planning. Optimization-based interaction synthesis relies on manually designing objective functions that may not generalize well. While crowd simulation involves more characters, their interactions are sparse and passive. We identify two challenges to multi-character interaction synthesis, including the lack of data and the planning of transitions among close and dense interactions. Existing datasets either do not have multiple characters or do not have close and dense interactions. The planning of transitions for multi-character close and dense interactions needs both spatial and temporal considerations. We propose a conditional generative pipeline comprising a coordinatable multi-character interaction space for interaction synthesis and a transition planning network for coordinations. Our experiments demonstrate the effectiveness of our proposed pipeline for multicharacter interaction synthesis and the applications facilitated by our method show the scalability and transferability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。