用贝叶斯优化提升轻量级人脸检测模型的压缩效率
B-FPGM: Lightweight Face Detection via Bayesian-Optimized Soft FPGM Pruning
- 结合FPGM与软剪枝,分层动态剪除冗余卷积核
- 在WIDER FACE上实现更小模型与更高精度的平衡
- 适合资源受限设备部署,开源代码可直接使用
人脸检测对轻量级模型的需求日益增长,以适应计算资源有限的设备部署。神经网络剪枝是一种有效降低模型规模而不显著影响性能的技术。本文提出一种新型的人脸检测剪枝流程B-FPGM,融合基于几何中位数的滤波器剪枝(FPGM)、软滤波器剪枝(SFP)和贝叶斯优化,以在模型大小与性能之间取得更优权衡。FPGM为结构化剪枝方法,可逐层剪除贡献最小的卷积核;SFP则通过迭代剪枝并允许后续训练更新滤波器。贝叶斯优化用于自动确定各层最优剪枝率,避免依赖人工经验。在WIDER FACE数据集的全部三个子集上,B-FPGM始终优于现有方法。实验基于当前参数最少且表现良好的人脸检测器EResFD展开,另附针对另一小型检测器EXTD的小规模消融实验。源代码与剪枝模型已公开于https://github.com/IDTITI/B-FPGM。
原文摘要 · Abstract (English)
Face detection is a computer vision application that increasingly demands lightweight models to facilitate deployment on devices with limited computational resources. Neural network pruning is a promising technique that can effectively reduce network size without significantly affecting performance. In this work, we propose a novel face detection pruning pipeline that leverages Filter Pruning via Geometric Median (FPGM) pruning, Soft Filter Pruning (SFP) and Bayesian optimization in order to achieve a superior trade-off between size and performance compared to existing approaches. FPGM pruning is a structured pruning technique that allows pruning the least significant filters in each layer, while SFP iteratively prunes the filters and allows them to be updated in any subsequent training step. Bayesian optimization is employed in order to optimize the pruning rates of each layer, rather than relying on engineering expertise to determine the optimal pruning rates for each layer. In our experiments across all three subsets of the WIDER FACE dataset, our proposed approach B-FPGM consistently outperforms existing ones in balancing model size and performance. All our experiments were applied to EResFD, the currently smallest (in number of parameters) well-performing face detector of the literature; a small ablation study with a second small face detector, EXTD, is also reported. The source code and trained pruned face detection models can be found at: https://github.com/IDTITI/B-FPGM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。