arXiv:2605.27336cs.CV2026-05

PARE通过动态剪枝与路由,让视频生成模型按需计算,节省算力。

PARE: Pruning and Adaptive Routing for Efficient Video Generation

论文配图:PARE: Pruning and Adaptive Routing for Efficient Video Generation
图 1 · 摘自论文原文
  • 按空间/时间角色区分注意力头,精准剪枝不丢关键运动信息
  • 根据输入内容和去噪阶段动态选择执行层,实现每帧自适应计算
  • 适合需要高效推理的视频生成场景,尤其对资源受限设备友好

视频扩散变换器(DiTs)能生成高质量视频,但因宽块、深结构和迭代采样而消耗大量算力。现有方法通过压缩宽度、深度或采样步数降低开销,但通常采用固定架构,无法适应不同输入或去噪阶段。本文提出PARE(Pruning and Adaptive Routing for Efficient Video Generation),联合压缩宽度与深度,结合结构感知剪枝和输入自适应路由。针对宽度,观察到注意力头具有空间与时间分工,设计区分重要性评分,避免关键时间头被过早剪枝;针对深度,训练轻量级路由器,基于去噪步数和视觉内容动态选择每步执行的模块,实现输入级算力自适应。采用渐进式流程:先通过知识蒸馏恢复剪枝后的宽度质量,再联合优化学生模型与路由器,解耦两个学习目标。在Wan2.1-14B数据集上,图像到视频与文本到视频生成任务中,PARE显著降低每步计算量,同时保持VBench各项指标性能,且可与步数蒸馏结合实现进一步加速。

原文摘要 · Abstract (English)

Video Diffusion Transformers (DiTs) generate high-quality videos but demand substantial compute due to wide blocks, deep architectures, and iterative sampling. Recent methods reduce cost by compressing width, depth, or sampling steps, but typically commit to a fixed architecture that cannot adapt to individual inputs or denoising stages. We propose PARE (Pruning and Adaptive Routing for Efficient video generation), which jointly compresses width and depth with structure-aware pruning and input-adaptive routing. For width, we observe that attention heads specialize into spatial and temporal roles, and design importance scoring that accounts for this distinction to prevent motion-critical temporal heads from being pruned prematurely. For depth, we train a lightweight router conditioned on denoising timestep and visual content to dynamically select which blocks to execute at each step, enabling per-input compute adaptation rather than static block removal. A progressive pipeline first recovers width-pruned quality via distillation, then jointly optimizes the student and router to decouple the two learning objectives. Experiments on Wan2.1-14B for both image-to-video and text-to-video generation show that PARE substantially reduces per-step computation while preserving quality across VBench dimensions, and composes with step distillation for further acceleration.

视频生成扩散模型高效推理动态路由

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。