arXiv:2504.20310cs.LGcs.AI2025-04被引 1

提出防御对抗样本的检测与缓解新视角,揭示生成任务中两者不可等价。

A Cryptographic Perspective on Mitigation vs. Detection in Machine Learning

  • 用三轮协议形式化定义检测与缓解防御机制
  • 生成任务中缓解可行而检测不可能,存在理论分离
  • 缓解计算开销远低于训练,适合资源受限场景

本文从密码学视角,对机器学习推理阶段对抗输入的检测与缓解进行形式化研究。定义了防御检测(DbD)和防御缓解(DbM),通过资源受限的两方三轮协议建模训练者/防御者与攻击者之间的互动。引入正确性、完备性和可靠性属性,确保防御有效且不显著损害模型在训练分布上的性能。对于分类任务,证明了DbD与DbM等价;但在生成学习任务中,因输出空间大,两者不等价。我们构造了两个生成任务实例,其中缓解可实现,但检测被严格证明不可行。缓解阶段所需计算资源远低于初始训练算法:第一例以样本复杂度为资源,第二例以时间复杂度为资源。前者依赖身份基全同态加密(IB-FHE)、可公开验证的零知识简洁非交互式知识论证(zk-SNARK)及强抗伪造签名;后者依赖非并行语言平均困难性(NPL)、增量可验证计算(IVC)和IB-FHE。

原文摘要 · Abstract (English)

In this paper, we initiate a cryptographically inspired theoretical study of detection versus mitigation of adversarial inputs produced by attackers on Machine Learning algorithms during inference time. We formally define defense by detection (DbD) and defense by mitigation (DbM). Our definitions come in the form of a 3-round protocol between two resource-bounded parties: a trainer/defender and an attacker. The attacker aims to produce inference-time inputs that fool the training algorithm. We define correctness, completeness, and soundness properties to capture successful defense at inference time while not degrading (too much) the performance of the algorithm on inputs from the training distribution. We first show that achieving DbD and achieving DbM are equivalent for ML classification tasks. Surprisingly, this is not the case for ML generative learning tasks, where there are many possible correct outputs for each input. We show a separation between DbD and DbM by exhibiting two generative learning tasks for which it is possible to defend by mitigation but it is provably impossible to defend by detection. The mitigation phase uses significantly less computational resources than the initial training algorithm. In the first learning task we consider sample complexity as the resource and in the second the time complexity. The first result holds under the assumption that the Identity-Based Fully Homomorphic Encryption (IB-FHE), publicly-verifiable zero-knowledge Succinct Non-Interactive Arguments of Knowledge (zk-SNARK), and Strongly Unforgeable Signatures exist. The second result assumes the existence of Non-Parallelizing Languages with Average-Case Hardness (NPL) and Incrementally-Verifiable Computation (IVC) and IB-FHE.

机器学习安全对抗样本密码学生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。