无需检测即可移除隐蔽后门,靠标签的数学特性实现安全防御
Oblivious Defense in ML Models: Backdoor Removal without Detection
- 利用标签的傅里叶或多项式特性,无需识别后门即可消除
- 对傅里叶密集标签,可全局移除所有后门;对线性/多项式标签,局部高效处理
- 全黑盒操作,不需模型参数或代码,适合实际部署场景
随着社会对机器学习依赖加深,防范复杂攻击成为紧迫问题。Goldwasser等(2022)证明,攻击者可植入难以检测的后门,使模型行为被秘密操控,且后门模型在计算上无法与无后门模型区分。本文提出防御策略,即使后门不可检测也能有效应对。核心思想是:基于真实标签的数学性质(如接近傅里叶密集函数),可无需检测直接证明性缓解或清除后门。我们定义了安全后门缓解标准,并给出两类结果:其一,在真实标签接近傅里叶密集函数时,提出‘全局缓解’技术可彻底移除所有后门;其二,当标签近似线性或多项式函数时,提出‘局部缓解’技术,以高概率在关键输入上移除后门,且计算成本低于全局方法。所有构造均为黑盒,无需访问模型结构或参数。同时,我们还证明了一个关于鲁棒均值估计的简单结果。
原文摘要 · Abstract (English)
As society grows more reliant on machine learning, ensuring the security of machine learning systems against sophisticated attacks becomes a pressing concern. A recent result of Goldwasser, Kim, Vaikuntanathan, and Zamir (2022) shows that an adversary can plant undetectable backdoors in machine learning models, allowing the adversary to covertly control the model's behavior. Backdoors can be planted in such a way that the backdoored machine learning model is computationally indistinguishable from an honest model without backdoors. In this paper, we present strategies for defending against backdoors in ML models, even if they are undetectable. The key observation is that it is sometimes possible to provably mitigate or even remove backdoors without needing to detect them, using techniques inspired by the notion of random self-reducibility. This depends on properties of the ground-truth labels (chosen by nature), and not of the proposed ML model (which may be chosen by an attacker). We give formal definitions for secure backdoor mitigation, and proceed to show two types of results. First, we show a "global mitigation" technique, which removes all backdoors from a machine learning model under the assumption that the ground-truth labels are close to a Fourier-heavy function. Second, we consider distributions where the ground-truth labels are close to a linear or polynomial function in $\mathbb{R}^n$. Here, we show "local mitigation" techniques, which remove backdoors with high probability for every inputs of interest, and are computationally cheaper than global mitigation. All of our constructions are black-box, so our techniques work without needing access to the model's representation (i.e., its code or parameters). Along the way we prove a simple result for robust mean estimation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。