用物理引导流匹配模型,让动作反应更自然且不穿模。
ARFlow: Human Action-Reaction Flow Matching with Physical Guidance
- 直接建立动作到反应的映射,省去复杂条件机制。
- 新采样方法减少90%以上身体穿透,提升运动多样性。
- 适合虚拟现实、社交机器人等需要真实互动的场景。
人类动作-反应合成是建模因果性人机交互的核心挑战,广泛应用于虚拟现实与社交机器人等领域。尽管基于扩散模型的方法表现良好,但在交互合成中仍存在两大问题:依赖复杂的噪声到反应生成器及繁琐的条件机制,以及生成动作频繁出现物理违规。为此,我们提出动作-反应流匹配(ARFlow)框架,建立从动作到反应的直接映射,避免复杂条件设计。引入专为流匹配(FM)设计的物理引导机制,在采样过程中有效防止身体穿透。同时,发现传统流匹配采样算法存在偏差,采用重投影方法修正采样方向,并在采样中引入随机性以增强反应多样性。在NTU120、Chi3D和InterHuman数据集上的大量实验表明,ARFlow不仅在弗雷谢尔初始距离(FID)和运动多样性上优于现有方法,还显著降低身体碰撞,其新提出的交集体积(Intersection Volume)和交集频率(Intersection Frequency)指标显示碰撞率下降超90%。
原文摘要 · Abstract (English)
Human action-reaction synthesis, a fundamental challenge in modeling causal human interactions, plays a critical role in applications ranging from virtual reality to social robotics. While diffusion-based models have demonstrated promising performance, they exhibit two key limitations for interaction synthesis: reliance on complex noise-to-reaction generators with intricate conditional mechanisms, and frequent physical violations in generated motions. To address these issues, we propose Action-Reaction Flow Matching (ARFlow), a novel framework that establishes direct action-to-reaction mappings, eliminating the need for complex conditional mechanisms. Our approach introduces a physical guidance mechanism specifically designed for Flow Matching (FM) that effectively prevents body penetration artifacts during sampling. Moreover, we discover the bias of traditional flow matching sampling algorithm and employ a reprojection method to revise the sampling direction of FM. To further enhance the reaction diversity, we incorporate randomness into the sampling process. Extensive experiments on NTU120, Chi3D and InterHuman datasets demonstrate that ARFlow not only outperforms existing methods in terms of Fréchet Inception Distance and motion diversity but also significantly reduces body collisions, as measured by our new Intersection Volume and Intersection Frequency metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。