arXiv:2604.18648cs.CVcs.AI2026-04

用舞蹈语法构建细粒度可控舞蹈生成模型,提升真实感与精准控制。

DanceCrafter: Fine-Grained Text-Driven Controllable Dance Generation via Choreographic Syntax

论文配图:DanceCrafter: Fine-Grained Text-Driven Controllable Dance Generation via Choreographic Syntax
图 1 · 摘自论文原文
  • 提出舞蹈语法框架与标注体系,统一复杂舞步描述
  • 构建41小时高精度动作数据集,含634万字描述文本
  • 设计人体解剖感知损失,实现肢体独立运动精确控制

文本驱动的可控舞蹈生成仍面临严重挑战,主要源于高质量数据稀缺及复杂编舞表达困难。舞蹈具有复杂的空间动态、强方向性以及身体各部位高度解耦的运动特性,难以建模。为此,我们融合舞蹈学、人体解剖学与生物力学原理,提出新型理论框架——编舞语法(Choreographic Syntax),并配套定制化标注系统。基于此语法,结合专业舞蹈档案与高保真动捕数据,构建了迄今最细粒度的舞蹈数据集DanceFlow,包含41小时高质量动作序列及634万字详细描述。在模型层面,提出基于Momentum Human Rig的定制化运动变换器DanceCrafter。为克服优化不稳定性,采用连续流形动作表示与混合归一化策略,并设计解剖感知损失函数,显式调控身体各部分的解耦运动。上述改进使DanceCrafter能稳定生成高保真复杂舞蹈序列。大量评估与用户研究验证其在动作质量、细粒度可控性与生成自然度上均达当前最优水平。

原文摘要 · Abstract (English)

Text-driven controllable dance generation remains under-explored, primarily due to the severe scarcity of high-quality datasets and the inherent difficulty of articulating complex choreographies. Characterizing dance is particularly challenging owing to its intricate spatial dynamics, strong directionality, and the highly decoupled movements of distinct body parts. To overcome these bottlenecks, we bridge principles from dance studies, human anatomy, and biomechanics to propose \textit{Choreographic Syntax}, a novel theoretical framework with a tailored annotation system. Grounded in this syntax, we combine professional dance archives with high-fidelity motion capture data to construct \textbf{DanceFlow}, the most fine-grained dance dataset to date. It encompasses 41 hours of high-quality motions paired with 6.34 million words of detailed descriptions. At the model level, we introduce \textbf{DanceCrafter}, a tailored motion transformer built upon the Momentum Human Rig. To circumvent optimization instabilities, we construct a continuous manifold motion representation paired with a hybrid normalization strategy. Furthermore, we design an anatomy-aware loss to explicitly regulate the decoupled nature of body parts. Together, these adaptations empower DanceCrafter to achieve the high-fidelity and stable generation of complex dance sequences. Extensive evaluations and user studies demonstrate our state-of-the-art performance in motion quality, fine-grained controllability, and generation naturalness.

舞蹈生成文本控制动作建模细粒度控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。