让人物在独处与互动间自然切换,生成连贯的长时序动作。
ARMS: Anchor-Relational Motion Streaming for Seamless Solo-Social Motion Transitions

- 用相对位移项分离个体动作与人际对齐,实现无缝切换。
- 在因果潜空间中逐段生成,保持长期稳定与空间一致性。
- 同一模型可生成独舞或双人互动,适合长程连续生成。
从文本生成时间连续且社交一致的人类动作仍是核心挑战,尤其在人们独自行动、进入互动又退出的真实场景中。现有方法通常在静态角色配置下生成固定长度动作片段,难以处理独处与互动之间的过渡,也不适合长时序增量生成。本文提出ARMS——一种锚点-关系动作流框架,将独处动作与人际交互统一于单一因果生成过程。ARMS引入动态非对称表示,通过以对方为参考的相对位移项,解耦个体时间演化与人际对齐,实现社交耦合的无缝切换,同时保持长时序稳定性与角色间空间一致性。基于因果潜空间,其采用因果关系扩散模型,仅依赖历史上下文逐步精炼动作,捕捉个体内部时间依赖与跨体关系。模式感知的关系门控可激活或屏蔽跨体连接,使同一模型支持独处与互动生成。实验表明,相比以互动为中心的基线,ARMS显著提升过渡平滑性与社交一致性,并在多人交互基准上达到竞争力表现。
原文摘要 · Abstract (English)
Generating temporally continuous and socially coherent human motion from text remains a fundamental challenge, particularly in realistic streams where people act alone, enter interactions, and later disengage. Most existing methods generate fixed-length motion clips under static agent configurations, which makes them brittle to solo-social transitions and unsuitable for incremental generation over long horizons. We propose ARMS, an Anchor-Relational Motion Streaming framework that unifies solo motion and human-human interaction within a single causal generative process. ARMS introduces a dynamics-asymmetric representation that decouples per-person temporal evolution from inter-person alignment via a partner-referenced relative-translation term, enabling seamless switching of social coupling without sacrificing long-horizon stability or spatial consistency between agents. On top of a causal latent space, a causal relational diffusion model progressively refines motion segment by segment using only past context, capturing both intra-person temporal dependencies and inter-person relations. Mode-aware relational gating activates or masks cross-agent connections, allowing the same model to support both solo and interaction generation. Experiments show that ARMS improves transition smoothness and social coherence compared to interaction-centric baselines, while also achieving competitive results on human-human interaction benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。