arXiv:2409.03077cs.LGcs.AI2024-09被引 3

提出防御后门攻击的新理论框架,揭示防御难易与学习能力的关系。

Backdoor defense, learnability and obfuscation

  • 用攻防博弈定义后门可防御性,要求攻击策略对随机触发器有效
  • 无计算限制下,防御性由函数类的VC维决定,类似学习能力
  • 多项式大小决策树可高效防御但难学习,是介于学习与混淆间的中间概念

我们引入一个形式化定义,通过攻击者与防御者之间的博弈来衡量对抗后门攻击的可防御性。攻击者修改函数使其在特定输入(称为‘触发器’)上表现异常,其余地方保持一致;防御者在评估时尝试检测该触发器。若防御者以足够高概率成功,则称该函数类具有可防御性。关键约束在于:攻击策略必须对随机选取的触发器有效。该定义虽未显式提及学习,但与可学习性密切相关。在计算无界情况下,利用Hanneke等(2022)的投票算法,证明可防御性基本由函数类的VC维决定,类似于PAC学习性。在计算有界情况下,表明高效PAC可学习性蕴含高效可防御性,但反之不成立。另一方面,借助不可区分混淆,证明多项式规模电路类无法高效防御。最后,给出多项式规模决策树作为自然例子,其防御比学习更容易。因此,我们识别出高效可防御性是介于高效可学习性与混淆之间的重要中间概念。

原文摘要 · Abstract (English)

We introduce a formal notion of defendability against backdoors using a game between an attacker and a defender. In this game, the attacker modifies a function to behave differently on a particular input known as the "trigger", while behaving the same almost everywhere else. The defender then attempts to detect the trigger at evaluation time. If the defender succeeds with high enough probability, then the function class is said to be defendable. The key constraint on the attacker that makes defense possible is that the attacker's strategy must work for a randomly-chosen trigger. Our definition is simple and does not explicitly mention learning, yet we demonstrate that it is closely connected to learnability. In the computationally unbounded setting, we use a voting algorithm of Hanneke et al. (2022) to show that defendability is essentially determined by the VC dimension of the function class, in much the same way as PAC learnability. In the computationally bounded setting, we use a similar argument to show that efficient PAC learnability implies efficient defendability, but not conversely. On the other hand, we use indistinguishability obfuscation to show that the class of polynomial size circuits is not efficiently defendable. Finally, we present polynomial size decision trees as a natural example for which defense is strictly easier than learning. Thus, we identify efficient defendability as a notable intermediate concept in between efficient learnability and obfuscation.

后门防御可学习性博弈论复杂性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。