融合特征与梯度信息,精准剪裁卷积通道提升模型效率
FGP: Feature-Gradient-Prune for Efficient Convolutional Layer Pruning
- 结合特征与梯度信息评估通道重要性
- 在多数据集上降低计算量且保持精度稳定
- 适合追求高效部署的模型压缩研究者
为在保持模型性能的同时降低计算开销,模型剪枝技术被广泛研究。其中,结构化剪枝通过移除整个卷积通道或层,显著提升计算效率并兼容硬件加速。然而,仅依赖图像特征或梯度的现有方法常保留冗余通道,影响推理效率。为此,本文提出一种新型剪枝方法——特征-梯度剪枝(FGP),融合特征与梯度信息,更准确评估不同目标类别下通道的重要性,从而更有效地识别对模型性能关键的通道。实验结果表明,该方法在多个任务和数据集上显著降低计算成本,同时最小化精度损失,提升了模型紧凑性与实用性。代码已公开于:https://github.com/FGP-code/FGP。
原文摘要 · Abstract (English)
To reduce computational overhead while maintaining model performance, model pruning techniques have been proposed. Among these, structured pruning, which removes entire convolutional channels or layers, significantly enhances computational efficiency and is compatible with hardware acceleration. However, existing pruning methods that rely solely on image features or gradients often result in the retention of redundant channels, negatively impacting inference efficiency. To address this issue, this paper introduces a novel pruning method called Feature-Gradient Pruning (FGP). This approach integrates both feature-based and gradient-based information to more effectively evaluate the importance of channels across various target classes, enabling a more accurate identification of channels that are critical to model performance. Experimental results demonstrate that the proposed method improves both model compactness and practicality while maintaining stable performance. Experiments conducted across multiple tasks and datasets show that FGP significantly reduces computational costs and minimizes accuracy loss compared to existing methods, highlighting its effectiveness in optimizing pruning outcomes. The source code is available at: https://github.com/FGP-code/FGP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。