无需训练即可同时处理连续与离散约束的可控动作生成方法
Training-free Controllable Human Motion Generation under Heterogeneous Constraints

- 将扩散模型生成视为随机控制问题,统一处理各类约束
- 支持不可导的离散准则约束,生成动作符合真实场景需求
- 适合需要灵活调整动作的虚拟人、动画生成等应用
无训练可控动作生成因可灵活施加约束而受到关注,但现有方法仅支持连续目标型且可微的约束。本文提出Motion-Inference-as-Control(MIC),首个可在统一框架下处理连续目标型与离散准则型约束的无训练生成方法。核心思想是将基于扩散的动作生成建模为随机控制问题,由此推导出无需可微性的分步控制律,自然兼容目标型约束作为特例,并引入面向控制的约束协调机制,动态平衡多约束冲突。在多种约束设置下的实验验证了该框架的有效性。
原文摘要 · Abstract (English)
Training-free controllable motion generation has attracted growing interest for enabling flexible constraint enforcement without constraint-specific training. However, existing training-free methods require constraints to be continuous objective-based with differentiable losses, while many real-world requirements are criterion-based and provide only discontinuous, sparse, or even black-box feedback. In this paper, we propose Motion-Inference-as-Control (MIC), the first training-free motion generation framework that handles both continuous objective-based and criterion-based motion constraints under a shared mechanism. The key idea is to cast diffusion-based motion generation as a stochastic control problem. This perspective not only provides principled and practically effective step-wise control laws that support criterion-based constraints without requiring differentiability and naturally accommodate objective-based constraints as a special case, but also motivates a control-oriented constraint coordination mechanism that adaptively balances and reconciles motion constraints during generation. Experiments across diverse constraint settings demonstrate the effectiveness of our framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。