arXiv:2410.10572cs.LGcs.CR2024-10被引 4

提出新型鲁棒可靠学习者,解决特定样本攻击下的模型可靠性问题。

Regularized Robustly Reliable Learners and Instance Targeted Attacks

  • 引入正则化鲁棒可靠学习框架,避免高复杂度模型下无法预测的困境。
  • 设计亚线性时间算法,显著降低测试时计算开销。
  • 适用于对抗数据投毒攻击场景,适合安全敏感应用研究者。

实例目标型数据投毒攻击通过污染训练数据,使模型在特定测试点出错,引发严重担忧。Balcan 等(2022)提出鲁棒可靠学习者的概念,在特定假设下为每个输入提供正确性保证,即使存在数据投毒攻击。他们给出了一个通用最优但计算低效的鲁棒可靠学习者,以及针对对数凹分布上线性分类器的高效算法。本文解决两个遗留问题:其一,原定义在高灵活假设类中会变得无意义——若存在两个在训练集上误差为零但对某点预测不同的分类器,则学习者必须在该点放弃预测。我们通过引入正则化鲁棒可靠学习者,允许在此类情况下仍做出非平凡预测。其二,原通用算法需对每个测试点重新运行ERM(经验风险最小化),通常不切实际。我们证明在某些有趣情形下,可借助动态算法设计技术,实现输出时间远低于训练时间的子线性算法。

原文摘要 · Abstract (English)

Instance-targeted data poisoning attacks, where an adversary corrupts a training set to induce errors on specific test points, have raised significant concerns. Balcan et al (2022) proposed an approach to addressing this challenge by defining a notion of robustly-reliable learners that provide per-instance guarantees of correctness under well-defined assumptions, even in the presence of data poisoning attacks. They then give a generic optimal (but computationally inefficient) robustly reliable learner as well as a computationally efficient algorithm for the case of linear separators over log-concave distributions. In this work, we address two challenges left open by Balcan et al (2022). The first is that the definition of robustly-reliable learners in Balcan et al (2022) becomes vacuous for highly-flexible hypothesis classes: if there are two classifiers h_0, h_1 \in H both with zero error on the training set such that h_0(x) \neq h_1(x), then a robustly-reliable learner must abstain on x. We address this problem by defining a modified notion of regularized robustly-reliable learners that allows for nontrivial statements in this case. The second is that the generic algorithm of Balcan et al (2022) requires re-running an ERM oracle (essentially, retraining the classifier) on each test point x, which is generally impractical even if ERM can be implemented efficiently. To tackle this problem, we show that at least in certain interesting cases we can design algorithms that can produce their outputs in time sublinear in training time, by using techniques from dynamic algorithm design.

对抗攻击鲁棒学习算法设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。