提出RPP框架,可在数据不平衡时可靠检测后门样本。
RPP: A Certified Poisoned-Sample Detection Framework for Backdoor Attacks under Dataset Imbalance
- 基于模型输出概率的黑盒检测,无需内部参数
- 在五大数据集上对10种攻击检测准确率显著领先
- 适合真实场景中存在类别不平衡的系统防御
深度神经网络极易遭受后门攻击,但现有防御方法多依赖数据平衡,忽略了现实场景中普遍存在的类别不平衡问题,而该问题会加剧后门威胁。本文首次深入研究数据不平衡如何放大后门脆弱性,发现:(i) 不平衡导致多数类偏差,增加模型易受攻击性;(ii) 传统防御方法在不平衡程度上升时性能显著下降。为此,我们提出随机概率扰动(RPP)——一种仅使用模型输出概率的可认证中毒样本检测框架。对于任意输入样本,RPP 能判定其是否被后门操控,并提供域内可检测性的可证明保证及假阳性率的随机上界。在五个基准数据集(MNIST、SVHN、CIFAR-10、TinyImageNet、ImageNet10)上,覆盖10种后门攻击和12种基线防御的实验表明,RPP 在数据不平衡条件下检测准确率显著优于现有最先进方法。RPP 为真实世界中存在数据不平衡的场景下抵御后门攻击提供了理论与实践基础。
原文摘要 · Abstract (English)
Deep neural networks are highly susceptible to backdoor attacks, yet most defense methods to date rely on balanced data, overlooking the pervasive class imbalance in real-world scenarios that can amplify backdoor threats. This paper presents the first in-depth investigation of how the dataset imbalance amplifies backdoor vulnerability, showing that (i) the imbalance induces a majority-class bias that increases susceptibility and (ii) conventional defenses degrade significantly as the imbalance grows. To address this, we propose Randomized Probability Perturbation (RPP), a certified poisoned-sample detection framework that operates in a black-box setting using only model output probabilities. For any inspected sample, RPP determines whether the input has been backdoor-manipulated, while offering provable within-domain detectability guarantees and a probabilistic upper bound on the false positive rate. Extensive experiments on five benchmarks (MNIST, SVHN, CIFAR-10, TinyImageNet and ImageNet10) covering 10 backdoor attacks and 12 baseline defenses show that RPP achieves significantly higher detection accuracy than state-of-the-art defenses, particularly under dataset imbalance. RPP establishes a theoretical and practical foundation for defending against backdoor attacks in real-world environments with imbalanced data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。