arXiv:2609.05448cs.AIcs.LG2026-09

用强化学习选关键模块,让大模型瘦身时更省力、效果更好。

Damage-Aware Bandit Pruning for Vision and Language Transformers

  • 把剪枝当多臂老虎机问题,动态评估每层模块的损伤
  • 在多个模型上比传统方法少退化,23次对比显著优于基线
  • 适合想高效压缩大模型但怕性能下降的研究者

对视觉与语言变压器进行结构化后训练剪枝,需选择能被抑制而影响小的完整功能单元。本文将此问题建模为固定评估预算下的损伤感知多臂老虎机问题。在校准批次中临时屏蔽注意力头和MLP通道组,通过屏蔽损失减去基础损失来计算成对损伤,降低批次间波动。使用平滑有界奖励驱动UCB策略或分数贝塔汤普森采样,逐步按步添加单元构建最终掩码。所选单元在原始密集检查点中被功能置零,因此报告的参数效应反映的是有效结构抑制而非物理压缩或速度提升。在WikiText-2、LAMBADA和Imagenette上的实验覆盖GPT-2、OPT、Pythia、Qwen2.5、SmolLM2、ViT-B/16、DeiT-Tiny和Swin-Tiny,对比随机、幅度、静态显著性及预算贪心剪枝方法。五组种子下,带损感知方法在语言模型成对比较中通常比预算贪心退化更少。论文突出的28次比较中,23个置信区间不包含零,11个配对检验p < 0.05;在全部116个数据集级测试中,经贝尼哈明-霍赫伯格校正后6个q < 0.05。ViT-B/16和Swin-Tiny的匹配评估表明其收益并非仅因更大候选评估预算所致。

原文摘要 · Abstract (English)

Structured post-training pruning of transformers requires selecting complete functional units whose suppression causes limited degradation. We formulate structured-unit selection for language and vision transformers as a damage-aware multi-armed bandit problem under a fixed candidate-evaluation budget. Attention heads and MLP channel groups are temporarily masked on calibration batches. Paired damage is the masked loss minus the base loss on the same batch, reducing batch-to-batch variation. A smooth bounded reward drives either a UCB-style policy or fractional-Beta Thompson Sampling, and the final mask is constructed sequentially by adding one unit at each step. The selected units are functionally zeroed in the original dense checkpoint; therefore, the reported parameter effects represent effective structural suppression rather than physical compression or measured speedup. Experiments on WikiText-2, LAMBADA, and Imagenette cover GPT-2, OPT, Pythia, Qwen2.5, SmolLM2, ViT-B/16, DeiT-Tiny, and Swin-Tiny, with comparisons against random, magnitude, static-saliency, and budgeted-greedy selection. Across five seeds, the bandit methods usually reduce degradation relative to budgeted greedy in the paired language-model comparisons. Of 28 comparisons highlighted in the paper, 23 bootstrap confidence intervals exclude zero and 11 paired tests have p < 0.05; six have q < 0.05 after Benjamini-Hochberg correction across the full family of 116 dataset-wise tests. Matched-evaluation results for ViT-B/16 and Swin-Tiny indicate that their gains are not explained solely by a larger candidate-evaluation budget.

模型剪枝大模型优化强化学习结构化压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。