arXiv:2509.25927cs.CVcs.AI2025-09中稿 · NeurIPS被引 1

数据量越大,模型越抗攻击,但数据质量更重要。

The Impact of Scaling Training Data on Adversarial Robustness

  • 研究36个视觉模型在120万到220亿图像上的抗攻击表现。
  • 数据量增10倍,攻击成功率平均降3.2%;模型规模增10倍,降13.4%。
  • 高质量小数据模型可超大规模低质数据模型,适合关注鲁棒性设计的研究者。

尽管架构和训练范式不断进步,深度神经网络仍易受对抗样本攻击。本文研究训练数据特性对36个主流视觉模型的影响,覆盖监督、自监督与对比学习方法,数据集规模从120万到220亿图像不等。模型在六类黑盒攻击下评估:随机扰动、两种几何掩码、COCO物体操作、ImageNet-C噪声污染及ImageNet-R风格变化。结果表明,鲁棒性遵循对数缩放规律:数据量增加十倍,攻击成功率(ASR)平均下降约3.2%;模型规模增加十倍,平均下降约13.4%。值得注意的是,部分在精炼数据集上训练的自监督模型(如DINOv2)优于在更大但粗糙数据集上训练的模型,挑战了单纯依赖规模提升鲁棒性的假设。对抗微调虽增强结构泛化能力,却无法改善颜色分布下的鲁棒性。人类评估显示,人机视觉差距依然显著。结论表明,尽管扩大规模有助于提升鲁棒性,但数据质量、架构设计与训练目标比单纯规模更具决定性作用。

原文摘要 · Abstract (English)

Deep neural networks remain vulnerable to adversarial examples despite advances in architectures and training paradigms. We investigate how training data characteristics affect adversarial robustness across 36 state-of-the-art vision models spanning supervised, self-supervised, and contrastive learning approaches, trained on datasets from 1.2M to 22B images. Models were evaluated under six black-box attack categories: random perturbations, two types of geometric masks, COCO object manipulations, ImageNet-C corruptions, and ImageNet-R style shifts. Robustness follows a logarithmic scaling law with both data volume and model size: a tenfold increase in data reduces attack success rate (ASR) on average by ~3.2%, whereas a tenfold increase in model size reduces ASR on average by ~13.4%. Notably, some self-supervised models trained on curated datasets, such as DINOv2, outperform others trained on much larger but less curated datasets, challenging the assumption that scale alone drives robustness. Adversarial fine-tuning of ResNet50s improves generalization across structural variations but not across color distributions. Human evaluation reveals persistent gaps between human and machine vision. These results show that while scaling improves robustness, data quality, architecture, and training objectives play a more decisive role than raw scale in achieving broad-spectrum adversarial resilience.

对抗鲁棒性数据规模自监督学习模型评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。