提出新威胁模型,区分安全与危险扰动
Disentangling Safe and Unsafe Corruptions via Anisotropy and Locality
- 基于输入局部的非各向同性方向识别危险扰动
- 小PD威胁包含大ℓₚ噪声、模糊等安全扰动
- 无需预训练,可灵活适配不同任务需求
当前机器学习系统对输入微小扰动敏感,现有威胁模型多采用各向同性、全局的ℓₚ范数定义,忽略扰动方向与位置。然而真实视觉污染如模糊、压缩、遮挡并不符合此类模型。本文提出 exttt{Projected Displacement}(PD)威胁模型,通过测量扰动在“危险方向”上的投影来评估威胁,危险方向定义为使真实标签改变的输入空间方向,基于训练数据局部确定。实验表明,对于任意输入,低PD威胁扰动包含ℓₚ范数大的安全扰动(如噪声、模糊、压缩),同时排除会改变标签的危险扰动。该模型不依赖大模型嵌入,无需预训练或微调,可直接应用于任意分类任务,并支持集成区域敏感性或概念层级等额外标注,为从业者提供灵活的任务驱动威胁定义。
原文摘要 · Abstract (English)
State-of-the-art machine learning systems are vulnerable to small perturbations to their input, where ``small'' is defined according to a threat model that assigns a positive threat to each perturbation. Most prior works define a task-agnostic, isotropic, and global threat, like the $\ell_p$ norm, where the magnitude of the perturbation fully determines the degree of the threat and neither the direction of the attack nor its position in space matter. However, common corruptions in computer vision, such as blur, compression, or occlusions, are not well captured by such threat models. This paper proposes a novel threat model called \texttt{Projected Displacement} (PD) to study robustness beyond existing isotropic and global threat models. The proposed threat model measures the threat of a perturbation via its alignment with \textit{unsafe directions}, defined as directions in the input space along which a perturbation of sufficient magnitude changes the ground truth class label. Unsafe directions are identified locally for each input based on observed training data. In this way, the PD threat model exhibits anisotropy and locality. Experiments on Imagenet-1k data indicate that, for any input, the set of perturbations with small PD threat includes \textit{safe} perturbations of large $\ell_p$ norm that preserve the true label, such as noise, blur and compression, while simultaneously excluding \textit{unsafe} perturbations that alter the true label. Unlike perceptual threat models based on embeddings of large-vision models, the PD threat model can be readily computed for arbitrary classification tasks without pre-training or finetuning. Further additional task annotation such as sensitivity to image regions or concept hierarchies can be easily integrated into the assessment of threat and thus the PD threat model presents practitioners with a flexible, task-driven threat specification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。