先学通用手部运动规律,再用少量标注数据实现精准控制。
Prior-First, Condition-Second: Scalable and Controllable Hand Motion Completion

- 先从无标签数据学通用手部运动规律,再轻量适配实现控制。
- 仅用数小时标注数据即可支持文本驱动的弱监督控制。
- 支持实时推理,适合动画生产管线中的交互式创作。
由于高自由度和语义标签缺失,生成与全身动作匹配的手部动作极具挑战。为此,我们提出先验优先、条件次之的框架,首先从大规模无结构、无标签动作数据中学习通用的躯干-手部运动先验,捕捉全局身体动态与手部动作间的内在协调性。通过在冻结先验上进行轻量级适配,引入语义控制,避免为每种控制接口重新学习运动结构。框架基于流式自回归的躯干-手部先验,利用结构化运动建模实现实时生成连贯且符合力学规律的手部动作。为在有限监督下实现实用可控性,我们设计语义分层适配器,在合适的运动层级注入控制信号,支持自监督属性控制与仅需数小时标注数据的弱监督文本控制。大量实验表明,相比端到端基线,该框架在低资源和跨数据集场景下显著提升运动合理性、鲁棒性和可控性。进一步展示实时推理与交互式创作流程,验证其在生产动画流水线中的适用性。
原文摘要 · Abstract (English)
Synthesizing hand motion that matches the full body motion and the semantic labels is a difficult task due to their high degrees of freedom and the lack of semantic labels. To cope with this issue, we propose a prior-first, condition-second framework for body-conditioned hand motion completion. Our framework first learns a generic body-hand kinematic prior from large-scale unstructured and unlabeled motion data, capturing the intrinsic coordination between global body dynamics and hand articulation. Semantic control is then introduced through lightweight adaptation on top of the frozen prior, avoiding the need to relearn kinematic structure for each control interface. Our framework centers on a streaming, autoregressive body-hand prior that generates coherent, kinematically consistent hand motion from body dynamics in real time, using structured kinematic modeling to maintain mechanical body-hand coupling. To enable practical controllability under limited supervision, we introduce semantically-layered adapters that inject conditioning signals at appropriate kinematic levels, supporting both self-supervised attribute control and weakly supervised text-driven control with only a few hours of labeled data. Extensive evaluations demonstrate that our framework improves kinematic plausibility, robustness, and controllability compared to end-to-end conditioned baselines, particularly in low-resource and cross-dataset settings. We further showcase real-time inference and an interactive authoring workflow, highlighting the applicability to production animation pipelines. Homepage: https://AIGAnimation.github.io/HandPrior/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。