arXiv:2607.25502cs.LGcs.CR2026-07

通过累积熵筛选纯净数据,高效防御神经网络后门攻击。

Anti-Backdoor Coreset Selection via Cumulative Entropy

  • 用累积熵衡量样本学习动态,优先选信息量高的正常样本。
  • 在多个攻击下均有效防御,自然准确率下降不足1%。
  • 适合需要高可靠性且兼顾性能的模型训练场景。

近期针对神经网络后门的训练阶段防御方法通过从污染数据中提取良性子集,以训练无后门模型。本文将该策略形式化为反后门核心集选择问题。由于恶意样本具有预测不确定性更低、出现频率更少的特点,核心集选择自然倾向于良性功能相关的样本。我们采用累积熵作为选择标准,追踪样本的学习动态,从而选出对模型有高信息量的良性样本。此外,每轮训练中对选定样本进行去学习,增强良性和恶意样本的可区分性。该方法构建了一个纯净核心集,用于训练无后门模型。相比以往方法在自然准确率上有所损失且对某些攻击失效,本方法在各类攻击下均表现稳定,对自然性能影响极小。

原文摘要 · Abstract (English)

Recent training-time defenses against neural backdoors isolate a benign subset from poisoned training data, to learn a backdoor-free model from it. In this paper, we formulate this defense strategy as a coreset selection problem, giving rise to so-called "Anti-Backdoor Coreset Selection." Since poisonous samples have (a) lower prediction uncertainty and are (b) less frequent than benign samples, coreset selection naturally focuses more on samples associated with benign functionality than the backdoor functionality. We use the Cumulative Entropy as selection criterion to further facilitate this effect. The metric tracks the learning dynamics of training samples and allowing us to select benign samples with high informativeness for the coreset. Additionally, we unlearn the chosen samples in each epoch to facilitate the separability between benign and poisonous samples. Together, this yields an exceptionally effective training-time defense that constructs a benign coreset to train a backdoor-free model. Unlike prior defenses that compromise natural accuracy and fail against certain attacks, our method mitigates backdooring attacks consistently with a negligible impact on natural performance.

后门防御核心集选择累积熵模型安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。