arXiv:2512.19692cs.CV2025-12被引 6

用自回归扩散模型生成逼真多人互动动作,支持手部细节与实时适应。

Interact2Ar: Full-Body Human-Human Interaction Generation via Autoregressive Diffusion Models

  • 采用自回归扩散架构,分路建模手部运动,实现全身动作高保真生成。
  • 通过大上下文记忆机制,可动态响应交互变化,支持多阶段动作合成。
  • 适用于多人交互、实时扰动应对等场景,评估指标专为全身体互动设计。

生成逼真的多人交互动作是一项挑战性任务,不仅需要高质量的全身与手部动作,还需协调多个参与者之间的行为。由于数据有限且学习复杂度高,以往方法常忽略手部运动,限制了交互的真实感与表现力。现有基于扩散模型的方法通常一次性生成完整序列,难以捕捉人类交互中的反应性与适应性。为此,我们提出 Interact2Ar,首个端到端的文本条件自回归扩散模型,用于生成包含全身与手部细节的多人交互动作。该模型通过并行分支引入精细的手部运动建模,实现高保真生成。同时,我们设计了自回归流程与新颖的记忆机制,利用高效的大上下文窗口,使模型能适应人类交互的内在变异性。该模型具备多种下游应用能力,包括时间上动作组合、对干扰的实时适应以及从两人扩展至多人场景。为验证生成效果,我们引入一套稳健的评估器与专门设计的扩展指标。定量与定性实验表明,Interact2Ar 达到当前最优性能。

原文摘要 · Abstract (English)

Generating realistic human-human interactions is a challenging task that requires not only high-quality individual body and hand motions, but also coherent coordination among all interactants. Due to limitations in available data and increased learning complexity, previous methods tend to ignore hand motions, limiting the realism and expressivity of the interactions. Additionally, current diffusion-based approaches generate entire motion sequences simultaneously, limiting their ability to capture the reactive and adaptive nature of human interactions. To address these limitations, we introduce Interact2Ar, the first end-to-end text-conditioned autoregressive diffusion model for generating full-body, human-human interactions. Interact2Ar incorporates detailed hand kinematics through dedicated parallel branches, enabling high-fidelity full-body generation. Furthermore, we introduce an autoregressive pipeline coupled with a novel memory technique that facilitates adaptation to the inherent variability of human interactions using efficient large context windows. The adaptability of our model enables a series of downstream applications, including temporal motion composition, real-time adaptation to disturbances, and extension beyond dyadic to multi-person scenarios. To validate the generated motions, we introduce a set of robust evaluators and extended metrics designed specifically for assessing full-body interactions. Through quantitative and qualitative experiments, we demonstrate the state-of-the-art performance of Interact2Ar.

动作生成扩散模型多人交互自回归

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。