用对抗性难度度量改进课程学习,提升模型泛化能力。
Flatness-aware Curriculum Learning via Adversarial Difficulty
- 提出对抗性难度度量ADM,基于平坦极小值的鲁棒性评估样本难易。
- 在图像分类、细粒度识别和域泛化任务上均超越现有方法。
- 适合追求强泛化性能的深度学习研究者使用。
通过经验风险最小化训练的神经网络常出现过拟合,尤其针对特定样本或领域,导致泛化能力差。课程学习(CL)通过根据样本难度选择训练数据来缓解此问题。从优化视角看,尖锐感知最小化(SAM)通过寻找平坦极小值提升模型鲁棒性和泛化能力。然而,将CL与SAM结合并不直接:在平坦区域,损失值和梯度范数趋于均匀变小,使得基于损失或梯度的难度评估失效。为此,我们提出对抗性难度度量(ADM),利用朝向平坦极小值训练的模型所具有的鲁棒性,量化对抗脆弱性。与依赖损失或梯度的度量不同,ADM通过测量原始样本与对抗样本之间的归一化损失差距,在训练进入平坦区域后仍保持有效性。我们将ADM融入基于SAM的课程学习训练中,实现样本难度的动态评估。在图像分类、细粒度识别和域泛化任务上的实验表明,该方法同时保留了CL和SAM的优势,优于现有的课程学习及平坦性感知训练策略。
原文摘要 · Abstract (English)
Neural networks trained by empirical risk minimization often suffer from overfitting, especially to specific samples or domains, which leads to poor generalization. Curriculum Learning (CL) addresses this issue by selecting training samples based on the difficulty. From the optimization perspective, methods such as Sharpness-Aware Minimization (SAM) improve robustness and generalization by seeking flat minima. However, combining CL with SAM is not straightforward. In flat regions, both the loss values and the gradient norms tend to become uniformly small, which makes it difficult to evaluate sample difficulty and design an effective curriculum. To overcome this problem, we propose the Adversarial Difficulty Measure (ADM), which quantifies adversarial vulnerability by leveraging the robustness properties of models trained toward flat minima. Unlike loss- or gradient-based measures, which become ineffective as training progresses into flatter regions, ADM remains informative by measuring the normalized loss gap between original and adversarial examples. We incorporate ADM into CL-based training with SAM to dynamically assess sample difficulty. We evaluated our approach on image classification tasks, fine-grained recognition, and domain generalization. The results demonstrate that our method preserves the strengths of both CL and SAM while outperforming existing curriculum-based and flatness-aware training strategies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。