TCDiff++让多人舞蹈生成更流畅,解决碰撞、滑步和长序列突变问题。
TCDiff++: An End-to-end Trajectory-Controllable Diffusion Model for Harmonious Music-Driven Group Choreography
- 用定位嵌入和距离一致性损失减少多人碰撞
- 引入换位嵌入与足部适配器,消除单人脚部滑动
- 长序列扩散采样策略适合生成长时间群舞
音乐驱动的舞蹈生成因其广泛工业应用而备受关注,尤其在群舞创作中。然而现有方法仍面临三大挑战:多人碰撞、单人脚部滑动以及长序列生成中的位置突变。本文提出TCDiff++,一种端到端的音乐驱动群舞生成框架。为缓解多人碰撞,采用舞者定位嵌入编码时空与身份信息,并引入距离一致性损失确保舞者间距合理。针对单人脚部滑动问题,设计换位嵌入以表征舞者交换模式,并构建足部适配器优化原始动作,减少滑步。对于长序列生成,提出长群组扩散采样策略,在噪声输入中注入位置信息,降低位置突变;同时集成序列解码层,提升模型对长序列的选择性处理能力。大量实验表明,TCDiff++在长时序场景下达到最优性能,生成高质量且连贯的群舞。
原文摘要 · Abstract (English)
Music-driven dance generation has garnered significant attention due to its wide range of industrial applications, particularly in the creation of group choreography. During the group dance generation process, however, most existing methods still face three primary issues: multi-dancer collisions, single-dancer foot sliding and abrupt swapping in the generation of long group dance. In this paper, we propose TCDiff++, a music-driven end-to-end framework designed to generate harmonious group dance. Specifically, to mitigate multi-dancer collisions, we utilize a dancer positioning embedding to encode temporal and identity information. Additionally, we incorporate a distance-consistency loss to ensure that inter-dancer distances remain within plausible ranges. To address the issue of single-dancer foot sliding, we introduce a swap mode embedding to indicate dancer swapping patterns and design a Footwork Adaptor to refine raw motion, thereby minimizing foot sliding. For long group dance generation, we present a long group diffusion sampling strategy that reduces abrupt position shifts by injecting positional information into the noisy input. Furthermore, we integrate a Sequence Decoder layer to enhance the model's ability to selectively process long sequences. Extensive experiments demonstrate that our TCDiff++ achieves state-of-the-art performance, particularly in long-duration scenarios, ensuring high-quality and coherent group dance generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。