揭示了鲁棒分类需海量数据的理论瓶颈,解释为何当前模型难兼顾准确与鲁棒。
Intriguing Properties of Robust Classification
- 理论证明:某些情况下学习鲁棒分类器需指数级数据量
- 实验证明:训练数据量是决定鲁棒性能的关键因素
- 发现非鲁棒泛化依赖低幅度数据方向,鲁棒模型无法利用
尽管过去十年学术界对对抗样本研究深入,但依然无法训练出在输入微小扰动下仍保持高精度的鲁棒分类器。以往观点认为这可能是因为不存在既准确又鲁棒的分类器,但在计算机视觉中,人类在多数任务上既准确又鲁棒,说明该假设不成立。本文提出新解释:在特定设置下,鲁棒泛化仅能在极大量数据下实现。具体而言,存在一个鲁棒分类器,准确分类器易学,但学习鲁棒分类器需指数级训练数据。基于此理论,我们评估了CIFAR-10等数据集上训练数据量的影响,结果表明数据量是决定鲁棒性能的核心因素。此外,我们发现数据中存在对非鲁棒泛化有用的低幅度方向,但鲁棒分类器无法利用这些方向。代码已开源。
原文摘要 · Abstract (English)
Despite extensive research since the community learned about adversarial examples 10 years ago, we still do not know how to train high-accuracy classifiers that are guaranteed to be robust to small perturbations of their inputs. Previous works often argued that this might be because no classifier exists that is robust and accurate at the same time. However, in computer vision this assumption does not match reality where humans are usually accurate and robust on most tasks of interest. We offer an alternative explanation and show that in certain settings robust generalization is only possible with unrealistically large amounts of data. Specifically, we find a setting where a robust classifier exists, it is easy to learn an accurate classifier, yet it requires an exponential amount of data to learn a robust classifier. Based on this theoretical result, we evaluate the influence of the amount of training data on datasets such as CIFAR-10. Our findings indicate that the amount of training data is the main factor determining the robust performance. Furthermore we show that there are low magnitude directions in the data which are useful for non-robust generalization but are not available for robust classifiers. We provide code at https://github.com/berndprach/IntriguingProperties.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。