提出一种两级可恢复剪枝框架,实现通信信号调制识别模型的极致压缩与高效推理。
FCOS: A Two-Stage Recoverable Model Pruning Framework for Automatic Modulation Recognition
- 先按通道级聚类融合剪枝,再用线性探测诊断层坍塌并移除
- 在Sig2019-12上实现95.51%计算量降低,参数减少95.31%
- 适合部署在资源受限设备上的高精度调制识别任务
随着无线通信快速发展和数字调制方案日益复杂,传统人工调制识别方法难以提取可靠信号特征,且无法满足现代场景下的实时性要求。近年来,基于深度学习的自动调制识别(AMR)方法显著提升了分类准确率,但其庞大的模型规模和高计算需求阻碍了在资源受限设备上的部署。模型剪枝是降低模型复杂度的通用方法,但现有权重、通道和层剪枝技术在压缩率、硬件加速与精度保持之间存在权衡。为此,本文提出FCOS——一种细粒度到粗粒度的两级剪枝框架,结合通道级剪枝与层坍塌诊断,实现极致压缩、高性能与高效推理。第一阶段采用层次聚类与参数融合对通道权重进行剪枝;第二阶段通过层坍塌诊断(LaCD)模块使用线性探测识别因通道压缩过高导致的层坍塌,并移除相应层。在多个AMR基准测试中,FCOS优于现有通道与层剪枝方法。具体而言,在Sig2019-12数据集上,实现了95.51%的FLOPs减少和95.31%的参数减少,同时仅造成0.46%的准确率下降,性能接近原始ResNet56。代码已开源:https://github.com/yaolu-zjut/FCOS。
原文摘要 · Abstract (English)
With the rapid development of wireless communications and the growing complexity of digital modulation schemes, traditional manual modulation recognition methods struggle to extract reliable signal features and meet real-time requirements in modern scenarios. Recently, deep learning based Automatic Modulation Recognition (AMR) approaches have greatly improved classification accuracy. However, their large model sizes and high computational demands hinder deployment on resource-constrained devices. Model pruning provides a general approach to reduce model complexity, but existing weight, channel, and layer pruning techniques each present a trade-off between compression rate, hardware acceleration, and accuracy preservation. To this end, in this paper, we introduce FCOS, a novel Fine-to-COarse two-Stage pruning framework that combines channel-level pruning with layer-level collapse diagnosis to achieve extreme compression, high performance and efficient inference. In the first stage of FCOS, hierarchical clustering and parameter fusion are applied to channel weights to achieve channel-level pruning. Then a Layer Collapse Diagnosis (LaCD) module uses linear probing to identify layer collapse and removes the collapsed layers due to high channel compression ratio. Experiments on multiple AMR benchmarks demonstrate that FCOS outperforms existing channel and layer pruning methods. Specifically, FCOS achieves 95.51% FLOPs reduction and 95.31% parameter reduction while still maintaining performance close to the original ResNet56, with only a 0.46% drop in accuracy on Sig2019-12. Code is available at https://github.com/yaolu-zjut/FCOS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。