arXiv:2606.14865cs.LGcs.AI2026-06

通过渐进式释放参数空间,提升小模型的对抗鲁棒性。

GRAPE: Guided Parameter-Space Evolution for Compact Adversarial Robustness

  • 先固定部分参数优化,逐步开放新维度,引导能力向高压模块集中。
  • 在相同计算量下,对抗准确率从51.70%提升至56.94%。
  • 适合追求轻量级高鲁棒性的模型设计与训练场景。

对抗训练(AT)能提升神经网络的鲁棒性,但多数方法从一开始就固定参数空间进行训练。本文探讨参数逐步可优化是否影响最终鲁棒性,即使最终架构和计算预算一致。提出GRAPE框架,结合参数空间稳定与渐进隐藏层扩展:先稳定当前可优化空间中的鲁棒优化,逐步释放新维度,并利用对抗谱利用率分数引导新增容量投入高压模块。相比固定结构的AT,GRAPE将鲁棒学习视为参数空间逐步暴露与演化的过程。在标准ℓ∞威胁模型下,基于CIFAR-10,以固定结构的ResNet-18 AT为对照,GRAPE在几乎相同的计算开销(FLOPs比1.009x)下,将PGD-20鲁棒准确率从51.70%提升至56.94%,同时参数量减少约21.4%。采用相同最终架构的顺序增长变体达到56.52%的鲁棒准确率,表明性能提升不仅源于最终结构差异,更来自参数空间暴露路径。结果表明,受控计算条件下,引导式参数空间演化可生成紧凑且鲁棒的参数配置。

原文摘要 · Abstract (English)

Adversarial Training (AT) improves neural network robustness, but most methods train a fixed parameter space from the start. This paper asks whether the order in which parameters become optimizable can affect the final robust solution, even when the final architecture or computation budget is controlled. We propose GRAPE, Guided Parameter-Space Evolution, a training framework for compact adversarial robustness. GRAPE combines parameter-space stabilization with progressive hidden expansion: it stabilizes robust optimization in the currently exposed space, gradually releases new optimizable dimensions, and uses an adversarial spectral utilization score to guide newly released capacity toward high-pressure modules. In contrast to fixed-structure AT, GRAPE treats robust model learning as a process of progressive parameter-space exposure and evolution. Under the standard $\ell_\infty$ threat model on CIFAR-10, with fixed-structure ResNet-18 AT as a controlled reference, GRAPE improves PGD-20 robust accuracy from 51.70% to 56.94% at a nearly matched computation budget with a FLOPs ratio of 1.009x, while reducing parameter count by about 21.4%. A sequential grow variant with the same final ResNet-18 architecture reaches 56.52% PGD-20 robust accuracy, indicating that the gain is not only due to final architecture differences but also to the parameter-space exposure path. These results suggest that guided parameter-space evolution can yield compact and robust parameter configurations under matched computation.

对抗训练参数演化轻量模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。