用剪枝压缩四元数卷积网络,音频分类更高效
Compressing Quaternion Convolutional Neural Networks for Audio Classification
- 对四元数卷积网络进行剪枝,降低计算开销
- 在AudioSet上减少50%计算量、80%参数量,性能相当
- 适合资源受限设备上的音频分类部署
传统实数域卷积神经网络在处理多通道输入时独立运算,难以捕捉通道间关联,影响复杂音频特征学习。四元数卷积神经网络(QCNN)通过四元数代数联合建模通道依赖,提升模型紧凑性与多维信号建模能力,但其运算复杂度高,推理延迟大,限制了在资源受限平台的部署。本文探索知识蒸馏与剪枝两种压缩方法,实验表明剪枝在保持或超越知识蒸馏性能的同时,计算开销更低。相比传统CNN和基于Transformer的架构,剪枝后的QCNN在保持竞争力的前提下,参数量与计算复杂度显著降低。在AudioSet数据集上,剪枝后计算成本下降50%,参数量减少80%,性能与传统CNN相当;且在GTZAN、ESC-50、RAVDESS等多个音频分类基准上具有良好泛化能力。
原文摘要 · Abstract (English)
Conventional Convolutional Neural Networks (CNNs) in the real domain have been widely used for audio classification. However, their convolution operations process multi-channel inputs independently, limiting the ability to capture correlations among channels. This can lead to suboptimal feature learning, particularly for complex audio patterns such as multi-channel spectrogram representations. Quaternion Convolutional Neural Networks (QCNNs) address this limitation by employing quaternion algebra to jointly capture inter-channel dependencies, enabling more compact models with fewer learnable parameters while better exploiting the multi-dimensional nature of audio signals. However, QCNNs exhibit higher computational complexity due to the overhead of quaternion operations, resulting in increased inference latency and reduced efficiency compared to conventional CNNs, posing challenges for deployment on resource-constrained platforms. To address this challenge, this study explores knowledge distillation (KD) and pruning, to reduce the computational complexity of QCNNs while maintaining performance. Our experiments on audio classification reveal that pruning QCNNs achieves similar or superior performance compared to KD while requiring less computational effort. Compared to conventional CNNs and Transformer-based architectures, pruned QCNNs achieve competitive performance with a reduced learnable parameter count and computational complexity. On the AudioSet dataset, pruned QCNNs reduce computational cost by 50\% and parameter count by 80\%, while maintaining performance comparable to the conventional CNNs. Furthermore, pruned QCNNs generalize well across multiple audio classification benchmarks, including GTZAN for music genre recognition, ESC-50 for environmental sound classification and RAVDESS for speech emotion recognition.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。