用扩散模型统一生成动作与状态,实现物理真实且可调控的长时运动规划。
Diffuse-CLoC: Guided Diffusion for Physics-based Character Look-ahead Control
- 将状态与动作联合建模于扩散框架中,通过状态条件控制动作生成。
- 在未见任务上实现障碍避让、运动插值等长时规划,性能超越传统分层方法。
- 无需高层规划器,单个预训练模型即可应对多种复杂下游任务。
我们提出 Diffuse-CLoC,一种用于基于物理的前瞻控制的引导式扩散框架,可实现直观、可操控且物理真实的运动生成。现有基于扩散模型的运动生成虽具备推理时条件控制能力,但常产生不具物理可行性的动作。而近期扩散控制策略虽能生成物理可实现的运动序列,却因缺乏运动学预测导致操控性不足。Diffuse-CLoC 的核心思想在于:在单一扩散模型中建模状态与动作的联合分布,使动作生成可通过预测状态进行条件控制。该方法结合了运动学生成中的成熟条件技术,同时保证物理真实性。由此实现无需高层规划器的运动规划能力。我们的方法通过单个预训练模型,成功处理多种未见的长时程下游任务,包括静态与动态障碍避让、运动插值及任务空间控制。实验表明,其性能显著优于传统的高层运动扩散与底层跟踪分层框架。
原文摘要 · Abstract (English)
We present Diffuse-CLoC, a guided diffusion framework for physics-based look-ahead control that enables intuitive, steerable, and physically realistic motion generation. While existing kinematics motion generation with diffusion models offer intuitive steering capabilities with inference-time conditioning, they often fail to produce physically viable motions. In contrast, recent diffusion-based control policies have shown promise in generating physically realizable motion sequences, but the lack of kinematics prediction limits their steerability. Diffuse-CLoC addresses these challenges through a key insight: modeling the joint distribution of states and actions within a single diffusion model makes action generation steerable by conditioning it on the predicted states. This approach allows us to leverage established conditioning techniques from kinematic motion generation while producing physically realistic motions. As a result, we achieve planning capabilities without the need for a high-level planner. Our method handles a diverse set of unseen long-horizon downstream tasks through a single pre-trained model, including static and dynamic obstacle avoidance, motion in-betweening, and task-space control. Experimental results show that our method significantly outperforms the traditional hierarchical framework of high-level motion diffusion and low-level tracking.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。