arXiv:2608.17657cs.CV2026-08中稿 · ECCV

提出新方法,在不重训情况下显著压缩ViT模型,保持高精度。

Denoised Variance-Based Pruning with Optimal Brain Bias Compensation

论文配图:Denoised Variance-Based Pruning with Optimal Brain Bias Compensation
图 1 · 摘自论文原文
  • 用随机矩阵理论去除激活方差噪声,更精准选关键神经元。
  • 50% MLP层剪枝后,小型和基础版模型仍保持90%以上原始准确率。
  • 无需训练即可生效,适合边缘设备部署的高效模型压缩场景。

视觉变换器(ViTs)虽性能领先,但计算开销大,限制了在边缘设备上的部署。结构化剪枝成为降低开销的关键策略,但现有方法常导致精度严重下降或需昂贵重训练。近期提出的基于方差的剪枝(VBP)通过激活方差选择神经元,但仍受有限样本下协方差统计噪声影响,且仅依赖偏置更新,无法充分补偿结构重建误差。为此,本文提出去噪方差剪枝与最优脑偏置补偿(DVBP + OB²C)。利用随机矩阵理论过滤激活协方差谱中的噪声,实现稳健神经元选择;并数学证明将均值偏移补偿融入最优脑压缩目标,可使层间海森矩阵精确等于激活协方差矩阵。由此可基于同一批统计量,以闭式解形式优化剩余权重。在DeiT、Swin和ConvNeXt架构上大量实验表明,该方法无需训练即达当前最佳性能:在50% MLP剪枝下,Small与Base版本保留超90%原始Top-1准确率,优于VBP最高达29.46%(ConvNeXt-T)和7.33%(Swin-S)。代码已开源。

原文摘要 · Abstract (English)

Vision Transformers (ViTs) achieve state-of-the-art performance but carry massive computational overhead that restricts edge deployment. Although structural pruning has emerged as a key strategy to reduce these costs, existing methods often suffer from severe accuracy degradation or require expensive retraining. Recently, Variance-Based Pruning (VBP) introduced a promising paradigm by selecting neurons based on activation variance; however, it remains limited by statistical noise in finite-sample activation covariance and reliance on bias-only updates that cannot fully account for structural reconstruction error. To address these limitations, we introduce Denoised Variance-Based Pruning with Optimal Brain Bias Compensation (DVBP + OB$^2$C). We leverage random matrix theory to filter noise from the activation covariance spectrum for robust neuron selection and mathematically prove that integrating mean-shift compensation into the Optimal Brain Compression objective reduces the layer-wise Hessian exactly to the activation covariance matrix. This enables an optimal, closed-form update of the remaining weights using the same statistics gathered for selection. Extensive experiments on DeiT, Swin, and ConvNeXt architectures demonstrate that DVBP + OB$^2$C achieves state-of-the-art training-free performance; at 50% MLP pruning, it retains over 90% of the original Top-1 accuracy on Small and Base variants, outperforming VBP by up to 29.46% (ConvNeXt-T) and 7.33% (Swin-S). The code is available at: https://github.com/geontackee/DVBP_OB2C.

模型压缩ViT剪枝无训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。