arXiv:2501.03507cs.CVcs.LG2025-01被引 1

通过多裁剪提升自监督学习效率,兼顾准确率与鲁棒性。

An Empirical Study of Accuracy-Robustness Tradeoff and Training Efficiency in Self-Supervised Learning

  • 采用多裁剪采样与不变性正则化加速收敛
  • 训练时间减少,同时提升干净准确率与抗攻击能力
  • 适合追求高效且鲁棒的自监督学习应用

自监督学习(SSL)在图像表征学习中取得显著进展,但对抗训练下的效率问题仍存。许多方法需大量训练轮次才能收敛,而对抗环境下这一需求更为突出。本文重新审视稳健的EMP-SSL框架,强调增加每张图像的裁剪数量可加速学习过程。不同于传统对比学习,稳健的EMP-SSL采用多裁剪采样,融合不变性项与正则化,有效降低训练轮次,提升时间效率。在标准线性分类器与多补丁嵌入聚合评估下,该方法揭示了新的评估策略。结果表明,稳健的基于裁剪的EMP-SSL不仅加快收敛,还实现了清洁准确率与对抗鲁棒性之间的更优平衡,优于多裁剪嵌入聚合。此外,我们引入无成本对抗训练于多裁剪自监督学习中,提出低成本对抗多裁剪自监督学习(CF-AMC-SSL)。CF-AMC-SSL在减少训练时间的同时,提升了清洁准确率与对抗鲁棒性。这些发现凸显了其在实际应用中的潜力。代码已公开于 https://github.com/softsys4ai/CF-AMC-SSL。

原文摘要 · Abstract (English)

Self-supervised learning (SSL) has significantly advanced image representation learning, yet efficiency challenges persist, particularly with adversarial training. Many SSL methods require extensive epochs to achieve convergence, a demand further amplified in adversarial settings. To address this inefficiency, we revisit the robust EMP-SSL framework, emphasizing the importance of increasing the number of crops per image to accelerate learning. Unlike traditional contrastive learning, robust EMP-SSL leverages multi-crop sampling, integrates an invariance term and regularization, and reduces training epochs, enhancing time efficiency. Evaluated with both standard linear classifiers and multi-patch embedding aggregation, robust EMP-SSL provides new insights into SSL evaluation strategies. Our results show that robust crop-based EMP-SSL not only accelerates convergence but also achieves a superior balance between clean accuracy and adversarial robustness, outperforming multi-crop embedding aggregation. Additionally, we extend this approach with free adversarial training in Multi-Crop SSL, introducing the Cost-Free Adversarial Multi-Crop Self-Supervised Learning (CF-AMC-SSL) method. CF-AMC-SSL demonstrates the effectiveness of free adversarial training in reducing training time while simultaneously improving clean accuracy and adversarial robustness. These findings underscore the potential of CF-AMC-SSL for practical SSL applications. Our code is publicly available at https://github.com/softsys4ai/CF-AMC-SSL.

自监督学习多裁剪对抗鲁棒性训练效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。