多角色动画统一框架,支持多角色协同动作生成。
MultiAnimate: A Unified Framework for Controllable Multi-Character Animation

- 通过多参考图像提取身份特征,支持多角色输入。
- 引入身份感知姿态编码器,准确区分多角色动作序列。
- 交互引导模块利用掩码信息优化复杂互动效果,适合影视动画应用。
生成模型与技术的进展已显著缓解角色图像动画的核心挑战。然而,现有方法大多局限于单参考图驱动的角色动画,严重限制了多角色交互场景的应用。为此,本文提出 MultiAnimate,一个统一框架,可在共享环境中同时动画化多个角色,保持身份一致性与空间关系。框架通过三项设计实现:首先,引入身份特异性参考网络,从多参考图中提取外观特征,突破单图输入限制;其次,设计身份感知姿态编码器,利用注意力机制精准区分并处理多角色姿态序列;第三,引入交互引导模块,通过角色特定掩码信息增强复杂角色间互动能力,作为可选组件优化姿态序列。大量实验与消融分析表明,该框架在多角色动画中表现优越,尤其在复杂运动序列场景下优势明显。
原文摘要 · Abstract (English)
Recent advances in generative models and technological innovations have significantly addressed the fundamental challenges of character image animation. However, existing approaches predominantly focus on character animation from a single reference image, substantially limiting their applicability in scenarios such as multiple character interaction animation. To fill this gap, this paper introduces MultiAnimate, a comprehensive framework that enables concurrent animation of multiple characters within a shared environment while preserving both identity consistency and spatial relationships. The framework achieves these objectives through multiple well-designed mechanisms. First, we incorporate an identity-specific reference net that enables appearance extraction from multiple reference images, distinguishing MultiAnimate from existing approaches constrained to single reference inputs. Second, we implement an identity-aware pose encoder to address the character-pose binding challenge, wherein an attention mechanism enables the network to accurately differentiate and process multiple pose sequences during generation. Third, we introduce an interaction guider module that enhances the framework's capability to handle complex inter-character interactions by leveraging character-specific mask information, serving as an optional component that refines the pose sequences. Extensive experiments and ablation analyses demonstrate our framework's superiority in multiple character animation, particularly in scenarios involving complex motion sequences.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。