arXiv:2608.20480cs.LGstat.ML2026-08

干净数据被恶意污染后,多分类学习可能完全失效。

When Clean Data Hurts: Learning with Monotone Corruptions Beyond Binary Classification

  • 设计自适应攻击者,可基于原始数据插入噪声样本
  • 仅需线性数量污染点,2维多分类问题即不可学
  • 小预算或非自适应攻击下仍可保持学习能力

经典 PAC 学习假设训练数据独立同分布。若其中混入来自无关甚至对抗源的正确标签样本,会怎样?近期研究提出单调对抗污染模型,发现所有已知最优二分类学习器误差率从 $O(d / n)$ 升至 $Ω(d /log(n / d) / n)$。本文进一步揭示:在多分类和部分二分类任务中,此类污染更致命。我们构造一个仅 2 维 DS 维度的可学习多分类问题,在自适应攻击者插入 $b = n$ 个污染样本后变为不可学;类似结果也适用于部分二分类情形。该攻击者可观察原始数据集 $S$ 并自适应添加 $b < ini$ 个样本。我们同时证明:当添加量为 $o(n)$ 时,所有类别仍可学习,且该界紧致。此外,在恒定预算 $b = O(1)$、仅观测 $p ext{-}fraction$($p \< 1$)或无法观测 $S$ 的对手下,经典多分类误差率 $O(d_{\mathrm{DS}} / n)$ 依然可达。

原文摘要 · Abstract (English)

Optimal learners are tailored to exploit the i.i.d.\ data assumption underlying the classic PAC model. What if an i.i.d.\ training sample were corrupted with correctly labeled examples drawn from an otherwise unrelated, even adversarial source? This model of learning with monotone adversarial corruptions was recently introduced by Larsen et al. (2026), who demonstrated that all known optimal binary learners suffer increased error rates in this setting, from $O(d / n)$ in the PAC model to $Ω(d \log(n / d) / n)$ under monotone corruption. Mehrotra (2026) proved this logarithmic factor to be necessary for binary classification, but left open the consequences of corruption for more general learning settings, such as multiclass classification and partial binary concept classes. As our primary result, we demonstrate that monotone adversaries are frighteningly more powerful in each of these settings. We exhibit a learnable multiclass problem, of DS dimension only 2, that becomes altogether unlearnable under a monotone adversary, and show an analogous result for partial binary concept classes. These results are achieved by an adaptive adversary permitted to view the original i.i.d.\ training set $S$ and to insert $b < \infty$ corrupted datapoints into $S$. In the multiclass example, the adversary need only insert a linear number $b = |S| = n$ of datapoints. We complement these impossibility results by proving that every class remains learnable when the number of adaptive additions is $o(n)$, which our previous multiclass lower bound proves to be tight. We further observe that the classic multiclass error rate of $O(d_{\mathrm{DS}} / n)$ remains achievable against adaptive adversaries restricted to a known constant budget $b = O(1)$, against semi-adaptive adversaries viewing only a $p$-fraction of $S$ for $p \in (0, 1)$, and against oblivious adversaries that cannot view $S$.

对抗学习多分类数据污染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。