arXiv:2604.23375cs.CVstat.ML2026-04

通过分层聚类压缩医学影像模型,显著降低计算量同时提升精度。

Hierarchical Spatio-Channel Clustering for Efficient Model Compression in Medical Image Analysis

论文配图:Hierarchical Spatio-Channel Clustering for Efficient Model Compression in Medical Image Analysis
图 1 · 摘自论文原文
  • 先分空间区域,再按通道激活模式聚类,最后自适应低秩分解
  • 压缩81.1%计算量,速度提升1.38倍,准确率从87.76%升至89.80%
  • 适合医疗影像部署,尤其对难分类病种效果更优

卷积神经网络(CNN)因内存与计算需求大,难以在资源受限环境部署。现有低秩压缩方法通常独立处理空间与通道冗余,未能充分挖掘特征图内的局部结构。本文提出一种分层时空-通道低秩压缩框架,首先将特征图划分为空间区域,再根据各区域内通道的协同激活模式分组,最后对每个时空-通道簇进行自适应SVD分解。在基于AlexNet的脑肿瘤MRI分类模型上评估,与全局SVD和Tucker分解对比,在3×和6×压缩预算下均表现更优:计算量由8.21 G降至1.55 G(减少81.1%),推理速度提升1.38倍,分类准确率从87.76%提高至89.80%。该方法还提升了宏观F1分数,改善了如脑膜瘤等难分类样本的表现。超参数分析表明框架可提供帕累托最优配置,适度聚类结合自适应秩选择即可获得优异结果。所有分类指标均报告了自举标准误。

原文摘要 · Abstract (English)

Convolutional neural networks (CNNs) have become increasingly difficult to deploy in resource-constrained environments due to their large memory and computational requirements. Although low-rank compression methods can reduce this burden, most existing approaches compress spatial and channel redundancy independently and therefore do not fully exploit the localised structure within convolutional feature maps. This paper proposes a hierarchical spatio-channel low-rank compression framework for CNNs that exploits redundancy across spatial regions and channel activations. Unlike conventional methods, which apply a uniform decomposition across an entire layer, the proposed approach first partitions feature maps into spatial regions, then groups channels according to their co-activation patterns within each region, and finally applies rank-adaptive SVD to each resulting spatio-channel cluster. The method is evaluated on an AlexNet-based brain tumour MRI classification model and compared with Global SVD and Tucker decomposition under \(3\times\) and \(6\times\) compression budgets. Our method outperforms both baselines, reducing FLOPs from \(8.21\,\mathrm{G}\) to \(1.55\,\mathrm{G}\) (\(81.1\%\) reduction), achieving a \(1.38\times\) inference speed-up, and increasing classification accuracy from \(87.76\%\) to \(89.80\%\). The method also improves the macro \(F_1\)-score and performance on challenging classes such as meningioma. A hyper-parameter trade-off analysis demonstrates that the framework provides Pareto-optimal configurations, enabling control over the balance between compression and predictive performance. Moderate clustering with adaptive rank selection yields strong results. Bootstrap standard errors are reported for all classification metrics.

模型压缩医学影像低秩分解CNN优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。