解决多人舞蹈生成的效率与碰撞问题,支持长时序流式生成。
ST-GDance++: A Scalable Spatial-Temporal Diffusion for Long-Duration Group Choreography
- 分离时空依赖,用轻量图卷积建模舞者关系,降低计算开销。
- 设计时序对齐注意力掩码与噪声调度,实现长序列流式生成。
- 在AIOZ-GDance数据集上生成质量媲美现有方法,延迟显著降低。
从音乐生成多人舞蹈需同步多舞者动作并保持空间协调,广泛应用于影视、游戏与动画。现有模型虽生成质量良好,但在交互场景中难以部署,因双向注意力导致计算复杂度随舞者数与序列长度呈平方增长,引发效率下降与动作碰撞风险。为应对挑战,本文提出ST-GDance++,通过解耦时空依赖,实现高效且防碰撞的群体编舞生成。空间建模采用轻量级距离感知图卷积,有效捕捉舞者间关系同时减少开销;时间建模引入扩散噪声调度策略与高效时序对齐注意力掩码,支持长序列流式生成,提升长时序场景可扩展性。在AIOZ-GDance数据集上的实验表明,该方法在生成质量上具有竞争力,同时显著降低延迟。
原文摘要 · Abstract (English)
Group dance generation from music requires synchronizing multiple dancers while maintaining spatial coordination, making it highly relevant to applications such as film production, gaming, and animation. Recent group dance generation models have achieved promising generation quality, but they remain difficult to deploy in interactive scenarios due to bidirectional attention dependencies. As the number of dancers and the sequence length increase, the attention computation required for aligning music conditions with motion sequences grows quadratically, leading to reduced efficiency and increased risk of motion collisions. Effectively modeling dense spatial-temporal interactions is therefore essential, yet existing methods often struggle to capture such complexity, resulting in limited scalability and unstable multi-dancer coordination. To address these challenges, we propose ST-GDance++, a scalable framework that decouples spatial and temporal dependencies to enable efficient and collision-aware group choreography generation. For spatial modeling, we introduce lightweight distance-aware graph convolutions to capture inter-dancer relationships while reducing computational overhead. For temporal modeling, we design a diffusion noise scheduling strategy together with an efficient temporal-aligned attention mask, enabling stream-based generation for long motion sequences and improving scalability in long-duration scenarios. Experiments on the AIOZ-GDance dataset show that ST-GDance++ achieves competitive generation quality with significantly reduced latency compared to existing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。