arXiv:2602.13326cs.CV2026-02被引 2

让多个不同人形角色在复杂互动中自然动画,突破单人限制。

MotionWeaver: Holistic 4D-Anchored Framework for Multi-Humanoid Image Animation

  • 用统一动作表示分离身份与动作,支持多种人形角色
  • 构建共享4D空间融合动作与视频特征,提升交互与遮挡处理能力
  • 首个支持多角色复杂互动的图像动画框架,适合角色动画研发者

角色图像动画能根据姿态序列生成参考角色的视频,但当前方法大多局限于单人场景。现有技术难以泛化至多人形场景,后者涉及多样人形、复杂互动和频繁遮挡。本文提出两项核心创新:首先,引入统一动作表示,提取与身份无关的动作并显式绑定至对应角色,实现跨多样化人形的泛化与无缝扩展;其次,提出整体4D锚定范式,构建共享4D空间融合动作表示与视频潜在特征,并通过分层4D级监督强化过程,更好处理交互与遮挡。我们基于这些思想构建了MotionWeaver框架,用于多角色图像动画。为支持该设定,我们采集了46小时含丰富互动的多人视频数据集,并构建包含300个视频的基准测试集,配有配对的人形角色。定量与定性实验表明,MotionWeaver不仅在基准测试上达到当前最优性能,还能有效泛化于多样人形、复杂互动及挑战性多角色场景。

原文摘要 · Abstract (English)

Character image animation, which synthesizes videos of reference characters driven by pose sequences, has advanced rapidly but remains largely limited to single-human settings. Existing methods struggle to generalize to multi-humanoid scenarios, which involve diverse humanoid forms, complex interactions, and frequent occlusions. We address this gap with two key innovations. First, we introduce unified motion representations that extract identity-agnostic motions and explicitly bind them to corresponding characters, enabling generalization across diverse humanoid forms and seamless extension to multi-humanoid scenarios. Second, we propose a holistic 4D-anchored paradigm that constructs a shared 4D space to fuse motion representations with video latents, and further reinforces this process with hierarchical 4D-level supervision to better handle interactions and occlusions. We instantiate these ideas in MotionWeaver, an end-to-end framework for multi-humanoid image animation. To support this setting, we curate a 46-hour dataset of multi-human videos with rich interactions, and construct a 300-video benchmark featuring paired humanoid characters. Quantitative and qualitative experiments demonstrate that MotionWeaver not only achieves state-of-the-art results on our benchmark but also generalizes effectively across diverse humanoid forms, complex interactions, and challenging multi-humanoid scenarios.

图像动画多角色4D建模人形生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。