arXiv:2609.07803cs.AI2026-09

研究剪枝对医学影像罕见病预测和解释可靠性的影响

Understanding the Impact of Model Pruning on Long-Tail Forgetting and Explanation Reliability in Medical Imaging

论文配图:Understanding the Impact of Model Pruning on Long-Tail Forgetting and Explanation Reliability in Medical Imaging
图 1 · 摘自论文原文
  • 对比四种剪枝方法在稀疏度达95%时的表现
  • 低频类别性能下降更早且更严重,解释稳定性依赖剪枝策略
  • 梯度感知剪枝能更好保留预测解释的可靠性

模型剪枝广泛用于压缩深度神经网络,在最小化性能损失的同时降低内存与计算开销。然而其对模型行为的影响仍不明确,尤其在长尾医学数据集上——罕见但临床重要的病症样本稀少。此外,剪枝后模型是否仍能提供可靠预测解释尚不清楚。为此,我们系统研究了剪枝下长尾遗忘现象与解释可靠性问题。在两个长尾医学影像数据集上,采用两种CNN架构、四种剪枝方法,覆盖最高95%稀疏度,评估预测性能、解释稳定性和解释忠实性。结果表明,预测性能呈现显著频率依赖趋势:低频类别普遍比高频类别更早且更大幅度退化。而解释稳定性和忠实性主要受剪枝策略影响,梯度感知方法在高强度压缩下更有效保持解释可靠性。定性与机制分析显示,解释退化主要源于类别判别梯度坍塌,而非特征激活消失。这些发现表明,模型压缩应超越整体性能评估。引入类别感知与解释感知评价可揭示隐藏失效模式,适度稀疏度在压缩、性能与解释可靠性间提供合理平衡。

原文摘要 · Abstract (English)

Model pruning is widely used to compress deep neural networks, reducing memory and computational requirements with minimal impact on aggregate performance. However, its effect on model behavior remains poorly understood, particularly for long-tailed medical datasets where rare but clinically important conditions are underrepresented. Furthermore, it remains unclear whether pruned models preserve reliable explanations of their predictions. To address this gap, we present a systematic study of long-tail forgetting and explanation reliability under model pruning. Across two long-tailed medical imaging datasets, two CNN architectures, four pruning methods, and sparsity levels up to 95\%, we evaluate predictive performance, explanation stability, and explanation faithfulness. Our results show that predictive performance exhibits a strong frequency-dependent trend, with lower-frequency classes generally experiencing earlier and larger degradation than higher-frequency classes. In contrast, explanation stability and faithfulness are influenced primarily by the pruning strategy, with gradient-informed methods preserving explanation reliability more effectively under aggressive compression. Qualitative and mechanistic analyses further indicate that explanation degradation is primarily associated with the collapse of class-discriminative gradients rather than the disappearance of feature activations. These findings suggest that model compression should be evaluated beyond aggregate performance. Incorporating class-aware and explanation-aware evaluation reveals failure modes that would otherwise remain hidden, while moderate sparsity levels provide a practical balance between compression, predictive performance, and explanation reliability.

模型剪枝医学影像解释可靠性长尾分布

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。