用对抗训练提升模型抗标签污染能力,有效防御恶意篡改数据。
Adversarial Training for Defense Against Label Poisoning Attacks
- 将攻击者与模型建模为博弈关系,通过双层优化防御标签污染
- 在多个分类任务中优于RoBERTa等基线模型,攻击预算越高越显著
- 适用于多种模型架构,理论分析支持收敛性,适合高风险场景
随着机器学习模型复杂度上升及对公开数据的依赖增强,尤其是大语言模型训练中的人工标注标签,其面临标签污染攻击的风险日益加剧。此类攻击通过细微修改训练数据标签,严重损害模型性能,对关键应用构成重大威胁。本文提出FLORAL,一种基于支持向量机(SVM)的新型对抗训练防御策略。采用双层优化框架,将训练过程建模为非零和斯塔克尔伯格博弈:攻击者战略性地污染关键训练标签,而模型则试图从中恢复。该方法兼容多种模型架构,使用核SVM结合投影梯度下降进行对抗训练。我们提供了算法收敛性的理论分析,并在多种分类任务上实证评估了FLORAL的有效性。相较于鲁棒基线与RoBERTa等基础模型,FLORAL在攻击预算增加时仍保持更高的鲁棒准确率。结果表明,FLORAL能有效提升模型对标签污染攻击的韧性,保障对抗环境下的可靠分类。
原文摘要 · Abstract (English)
As machine learning models grow in complexity and increasingly rely on publicly sourced data, such as the human-annotated labels used in training large language models, they become more vulnerable to label poisoning attacks. These attacks, in which adversaries subtly alter the labels within a training dataset, can severely degrade model performance, posing significant risks in critical applications. In this paper, we propose FLORAL, a novel adversarial training defense strategy based on support vector machines (SVMs) to counter these threats. Utilizing a bilevel optimization framework, we cast the training process as a non-zero-sum Stackelberg game between an attacker, who strategically poisons critical training labels, and the model, which seeks to recover from such attacks. Our approach accommodates various model architectures and employs a projected gradient descent algorithm with kernel SVMs for adversarial training. We provide a theoretical analysis of our algorithm's convergence properties and empirically evaluate FLORAL's effectiveness across diverse classification tasks. Compared to robust baselines and foundation models such as RoBERTa, FLORAL consistently achieves higher robust accuracy under increasing attacker budgets. These results underscore the potential of FLORAL to enhance the resilience of machine learning models against label poisoning threats, thereby ensuring robust classification in adversarial settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。