通过音乐驱动的协同分解,提升多人舞蹈生成的同步性与自然度。
CoheDancers: Enhancing Interactive Group Dance Generation through Music-Driven Coherence Decomposition
- 将群体舞蹈协同性拆解为同步、自然、流畅三要素,分别设计对应策略。
- 在I-Dancers数据集上达到最佳表现,生成舞蹈更连贯美观。
- 适合虚拟演出、游戏动画等需要多人协同舞蹈生成的场景。
舞蹈生成在舞蹈表演和虚拟游戏等领域至关重要且极具挑战。现有研究多聚焦于单人音乐到舞蹈(Solo Music2Dance),而针对多人音乐到舞蹈(Group Music2Dance)的研究常因缺乏协同性导致表现不佳。为此,本文提出CoheDancers框架,通过将群体舞蹈协同性分解为同步性、自然性和流畅性三个核心维度,分别设计循环一致性同步策略、自回归暴露偏差修正策略与对抗训练策略,显著提升生成舞蹈质量。此外,构建了当前最全面的开源数据集I-Dancers,包含丰富舞者互动,并设计了综合性评估指标。实验在I-Dancers及其他公开数据集上验证了CoheDancers优于现有方法的性能。代码将开源。
原文摘要 · Abstract (English)
Dance generation is crucial and challenging, particularly in domains like dance performance and virtual gaming. In the current body of literature, most methodologies focus on Solo Music2Dance. While there are efforts directed towards Group Music2Dance, these often suffer from a lack of coherence, resulting in aesthetically poor dance performances. Thus, we introduce CoheDancers, a novel framework for Music-Driven Interactive Group Dance Generation. CoheDancers aims to enhance group dance generation coherence by decomposing it into three key aspects: synchronization, naturalness, and fluidity. Correspondingly, we develop a Cycle Consistency based Dance Synchronization strategy to foster music-dance correspondences, an Auto-Regressive-based Exposure Bias Correction strategy to enhance the fluidity of the generated dances, and an Adversarial Training Strategy to augment the naturalness of the group dance output. Collectively, these strategies enable CohdeDancers to produce highly coherent group dances with superior quality. Furthermore, to establish better benchmarks for Group Music2Dance, we construct the most diverse and comprehensive open-source dataset to date, I-Dancers, featuring rich dancer interactions, and create comprehensive evaluation metrics. Experimental evaluations on I-Dancers and other extant datasets substantiate that CoheDancers achieves unprecedented state-of-the-art performance. Code will be released.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。