不需微调即可去除卷积层冗余,提升模型压缩率。
LinDeps: A Fine-tuning Free Post-Pruning Method to Remove Layer-Wise Linear Dependencies with Guaranteed Performance Preservation
- 通过特征图的选主元QR分解识别线性相关滤波器。
- 在CIFAR-10和ImageNet上实现更高压缩率且性能不变。
- 适合资源受限场景,无需重训练即可部署使用。
卷积神经网络在计算机视觉任务中广泛应用,但其日益增长的规模与复杂性给资源受限平台的高效部署带来挑战。网络剪枝成为降低模型大小与计算量的有效手段,但如何在不损害性能的前提下最优移除冗余仍是一大难题。现有方法普遍忽视层内特征图间的结构依赖关系,导致剪枝决策次优。本文提出LinDeps,一种可应用于任意剪枝方法之上的后处理剪枝新方法,通过线性依赖分析系统性地识别并移除冗余滤波器。具体而言,采用选主元QR分解检测并剪除线性相关的滤波器,并引入新型信号恢复机制调整下一层卷积核,以保持层间兼容性和性能,无需任何微调。在VGG与ResNet架构下,基于CIFAR-10与ImageNet的实验表明,LinDeps在保持性能的同时显著提升压缩率,达到当前卷积神经网络剪枝的新基准。此外,在无法重训练的低资源设置中,相比现有先进方法,仍实现显著剪枝提升与推理加速。因此,LinDeps可作为当前及未来剪枝技术的必备增强模块。
原文摘要 · Abstract (English)
Convolutional Neural Networks (CNN) are widely used in many computer vision tasks. Yet, their increasing size and complexity pose significant challenges for efficient deployment on resource-constrained platforms. Hence, network pruning has emerged as an effective way of reducing the size and computational requirements of neural networks by removing redundant or unimportant parameters. However, a fundamental challenge with pruning consists in optimally removing redundancies without degrading performance. Most existing pruning techniques overlook structural dependencies across feature maps within a layer, resulting in suboptimal pruning decisions. In this work, we introduce LinDeps, a novel post-pruning method, i.e., a pruning method that can be applied on top of any pruning technique, which systematically identifies and removes redundant filters via linear dependency analysis. Particularly, LinDeps applies pivoted QR decomposition to feature maps to detect and prune linearly dependent filters. Then, a novel signal recovery mechanism adjusts the next layer's kernels to preserve compatibility and performance without requiring any fine-tuning. Our experiments on CIFAR-10 and ImageNet with VGG and ResNet backbones demonstrate that LinDeps improves compression rates of existing pruning techniques while preserving performances, leading to a new state of the art in CNN pruning. We also benchmark LinDeps in low-resource setups where no retraining can be performed, which shows significant pruning improvements and inference speedups over a state-of-the-art method. LinDeps therefore constitutes an essential add-on for any current or future pruning technique.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。