arXiv:2604.20470cs.CV2026-04被引 1

动态稀疏注意力让长视频生成更快更准,关键信息不丢失。

DynamicRad: Content-Adaptive Sparse Attention for Long Video Diffusion

论文配图:DynamicRad: Content-Adaptive Sparse Attention for Long Video Diffusion
图 1 · 摘自论文原文
  • 根据时空能量分布设计动态稀疏注意力机制
  • 速度提升1.7到2.5倍,有效稀疏度超80%
  • 适合追求高效与长视频质量的生成任务

视频扩散模型中的自然时空能量衰减为效率提升提供了路径,但仅依赖固定稀疏掩码可能损失复杂动态中的关键信息。为此,我们提出DynamicRad,一种基于径向局部性先验的统一稀疏注意力范式。该方法采用双模式策略:静态比例模式用于加速,动态阈值模式用于保质。为避免在线搜索开销,引入离线贝叶斯优化(BO)流程与语义运动路由模块,该轻量投影模块将提示嵌入映射至最优稀疏度配置,实现极低运行时开销。相比在线分析,离线BO在物理代理任务上优化注意力重建误差(MSE),确保快速收敛。在HunyuanVideo和Wan2.1-14B上的实验表明,DynamicRad显著提升效率-质量权衡,实现1.7×–2.5×推理加速,且有效稀疏度超过80%。在某些长序列场景中,动态模式甚至达到或超越稠密基线,掩码感知LoRA进一步提升长时程一致性。代码已开源。

原文摘要 · Abstract (English)

Leveraging the natural spatiotemporal energy decay in video diffusion offers a path to efficiency, yet relying solely on rigid static masks risks losing critical long-range information in complex dynamics. To address this issue, we propose \textbf{DynamicRad}, a unified sparse-attention paradigm that grounds adaptive selection within a radial locality prior. DynamicRad introduces a \textbf{dual-mode} strategy: \textit{static-ratio} for speed-optimized execution and \textit{dynamic-threshold} for quality-first filtering. To ensure robustness without online search overhead, we integrate an offline Bayesian Optimization (BO) pipeline coupled with a \textbf{semantic motion router}. This lightweight projection module maps prompt embeddings to optimal sparsity regimes with \textbf{minimal runtime overhead}. Unlike online profiling methods, our offline BO optimizes attention reconstruction error (MSE) on a physics-based proxy task, ensuring rapid convergence. Experiments on HunyuanVideo and Wan2.1-14B demonstrate that DynamicRad pushes the efficiency--quality Pareto frontier, achieving \textbf{1.7$\times$--2.5$\times$ inference speedups} with \textbf{over 80\% effective sparsity}. In some long-sequence settings, the dynamic mode even matches or exceeds the dense baseline, while mask-aware LoRA further improves long-horizon coherence. Code is available at https://github.com/Adamlong3/DynamicRad.

视频生成扩散模型稀疏注意力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。