arXiv:2602.20111cs.LG2026-02被引 2

在对抗注入场景下,提出新方法实现可靠拒绝预测,并给出理论下界与上界。

Reliable Abstention under Adversarial Injections: Tight Lower Bounds and New Upper Bounds

  • 基于鲁棒见证构造潜在函数框架,提升抗干扰能力。
  • 首次证明VC维1时误差下界为Ω(√T),揭示信息差异本质。
  • 适用于无分布假设的半平面分类,适合安全敏感场景。

我们研究了由Goel等(2017)提出的对抗注入在线学习模型,其中标签数据流主要独立同分布于未知分布𝒟,但可能被敌意样本插入,且学习者无法识别哪些轮次是攻击。关键在于标签始终与固定目标概念一致(干净标签设定)。学习者可选择拒绝预测,总误差包括预测错误和在独立同分布轮次中错误拒绝。已有研究表明,若拥有分布查询权限,可达到O(d² log T)的联合误差(VC维为d),而无分布算法仅能实现受限类别的~O(√T)。本文通过证明VC维1时联合误差存在Ω(√T)下界,解决了这一差距是否本质的问题。算法方面,提出一种基于潜在函数的框架,利用‘鲁棒见证’——小规模标签子集,在保持对敌意污染鲁棒性的同时认证预测。该框架通过两个组合维度实例化:(1) 推理维数,得到推理维数为k时误差~O(T^{1−1/k});(2) 提出新的‘证书维数’。作为应用,证明ℝ²中半平面的证书维数为3,首次获得该类别的分布无关~O(T^{2/3})上界。值得注意的是,Blum等(2021)曾证明半平面在无拒绝机制下无法在干净标签攻击下稳健学习。

原文摘要 · Abstract (English)

We study online learning in the adversarial injection model introduced by [Goel et al. 2017], where a stream of labeled examples is predominantly drawn i.i.d.\ from an unknown distribution $\mathcal{D}$, but may be interspersed with adversarially chosen instances without the learner knowing which rounds are adversarial. Crucially, labels are always consistent with a fixed target concept (the clean-label setting). The learner is additionally allowed to abstain from predicting, and the total error counts the mistakes whenever the learner decides to predict and incorrect abstentions when it abstains on i.i.d.\ rounds. Perhaps surprisingly, prior work shows that oracle access to the underlying distribution yields $O(d^2 \log T)$ combined error for VC dimension $d$, while distribution-agnostic algorithms achieve only $\tilde{O}(\sqrt{T})$ for restricted classes, leaving open whether this gap is fundamental. We resolve this question by proving a matching $Ω(\sqrt{T})$ lower bound for VC dimension $1$, establishing a sharp separation between the two information regimes. On the algorithmic side, we introduce a potential-based framework driven by \emph{robust witnesses}, small subsets of labeled examples that certify predictions while remaining resilient to adversarial contamination. We instantiate this framework using two combinatorial dimensions: (1) \emph{inference dimension}, yielding combined error $\tilde{O}(T^{1-1/k})$ for classes of inference dimension $k$, and (2) \emph{certificate dimension}, a new relaxation we introduce. As an application, we show that halfspaces in $\mathbb{R}^2$ have certificate dimension $3$, obtaining the first distribution-agnostic bound of $\tilde{O}(T^{2/3})$ for this class. This is notable since [Blum et al. 2021] showed halfspaces are not robustly learnable under clean-label attacks without abstention.

在线学习对抗攻击拒绝预测理论分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。