通过渐进式删除冗余模块,在不损失精度前提下减少动作检测模型计算量。
Temporal Action Detection Model Compression by Progressive Block Drop
- 以删块代替剪枝,保持大矩阵运算提升GPU并行效率
- 在THUMOS14和ActivityNet-1.3上实现25%计算量下降且精度无损
- 可与通道剪枝互补,适合资源受限的自动驾驶等场景
时序动作检测(TAD)旨在识别和定位未剪辑视频中的动作实例,对多种视频理解任务至关重要。然而,近年来模型性能的提升依赖于更大的特征提取器和数据集,导致计算开销显著增加,这对自动驾驶、机器人等计算资源有限的应用构成挑战。现有通道剪枝方法虽能压缩模型,但减少通道数会降低GPU并行效率,因小矩阵乘法效率低下。为此,本文提出渐进式块删除(Progressive Block Drop)方法,通过减少模型深度而非通道数来压缩模型,保持层宽不变,仍使用大矩阵计算,从而降低乘法次数。该方法分两步进行:首先剔除对性能影响最小的冗余块;其次采用参数高效的跨深度对齐技术,微调剪枝后的模型以恢复精度。实验表明,该方法在两个TAD基准(THUMOS14与ActivityNet-1.3)上实现了25%的计算开销减少,且精度无损。更重要的是,实证显示该方法与通道剪枝具有正交性,可联合使用以获得更高压缩效率。
原文摘要 · Abstract (English)
Temporal action detection (TAD) aims to identify and localize action instances in untrimmed videos, which is essential for various video understanding tasks. However, recent improvements in model performance, driven by larger feature extractors and datasets, have led to increased computational demands. This presents a challenge for applications like autonomous driving and robotics, which rely on limited computational resources. While existing channel pruning methods can compress these models, reducing the number of channels often hinders the parallelization efficiency of GPU, due to the inefficient multiplication between small matrices. Instead of pruning channels, we propose a Progressive Block Drop method that reduces model depth while retaining layer width. In this way, we still use large matrices for computation but reduce the number of multiplications. Our approach iteratively removes redundant blocks in two steps: first, we drop blocks with minimal impact on model performance; and second, we employ a parameter-efficient cross-depth alignment technique, fine-tuning the pruned model to restore model accuracy. Our method achieves a 25% reduction in computational overhead on two TAD benchmarks (THUMOS14 and ActivityNet-1.3) to achieve lossless compression. More critically, we empirically show that our method is orthogonal to channel pruning methods and can be combined with it to yield further efficiency gains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。