arXiv:2511.20431cs.CVcs.RO2025-11AAAI

让虚拟人动作既自然又真实,解决生成与执行脱节问题

BRIC: Bridging Kinematic Plans and Physical Control at Test Time

  • 测试时动态调整物理控制器,修正生成动作的偏差
  • 在多种任务中实现稳定且物理合理的长期动作执行
  • 无需更新模型参数,适合快速部署到新场景

我们提出BRIC,一种新型测试时自适应(TTA)框架,通过解决基于扩散模型的姿态规划器与基于强化学习的物理控制器之间的执行差异,实现长时序人类动作生成。尽管扩散模型能根据文本和场景上下文生成多样且富有表现力的动作,但常产生物理上不合理的输出,导致仿真中的执行漂移。为应对这一问题,BRIC在测试时动态调整物理控制器以适应噪声化的运动计划,同时通过损失函数保护预训练技能,避免灾难性遗忘。此外,BRIC引入轻量级测试时引导机制,在信号空间中引导扩散模型,无需更新其参数。结合两种策略,BRIC在多样化环境中实现了高效、一致且物理合理的长期动作执行。我们在多种长时任务上验证了其有效性,包括动作组合、避障和人-场景交互,所有任务均达到当前最优性能。

原文摘要 · Abstract (English)

We propose BRIC, a novel test-time adaptation (TTA) framework that enables long-term human motion generation by resolving execution discrepancies between diffusion-based kinematic motion planners and reinforcement learning-based physics controllers. While diffusion models can generate diverse and expressive motions conditioned on text and scene context, they often produce physically implausible outputs, leading to execution drift during simulation. To address this, BRIC dynamically adapts the physics controller to noisy motion plans at test time, while preserving pre-trained skills via a loss function that mitigates catastrophic forgetting. In addition, BRIC introduces a lightweight test-time guidance mechanism that steers the diffusion model in the signal space without updating its parameters. By combining both adaptation strategies, BRIC ensures consistent and physically plausible long-term executions across diverse environments in an effective and efficient manner. We validate the effectiveness of BRIC on a variety of long-term tasks, including motion composition, obstacle avoidance, and human-scene interaction, achieving state-of-the-art performance across all tasks.

动作生成测试时适应物理控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。