arXiv:2410.10744cs.LGcs.CV2024-10ICLR被引 14

用动态系统稳定理论提升模型对抗攻击下的异常检测能力

Adversarially Robust Out-of-Distribution Detection Using Lyapunov-Stabilized Embeddings

  • 通过神经微分方程构建稳定嵌入空间,使数据收敛到固定平衡点
  • 在对抗攻击下检测准确率从37.8%提升至80.1%(CIFAR-10 vs. CIFAR-100)
  • 无需额外数据,用低概率区域生成假异常样本增强鲁棒性

尽管分布外(OOD)检测已有显著进展,现有方法在对抗攻击下仍难以保持鲁棒性,影响其在关键应用中的可靠性。以往研究尝试通过引入辅助OOD数据集并结合对抗训练来缓解此问题,但对抗训练带来的数据复杂性以及测试时OOD样本的多样性,常导致决策边界不稳固。为此,我们提出AROS,一种基于神经常微分方程(NODEs)与李雅普诺夫稳定性定理的新方法,用于构建鲁棒的嵌入表示。通过设计特定损失函数,利用李雅普诺夫稳定性理论确保分布内(ID)和分布外(OOD)数据均收敛至动力系统的稳定平衡点。该机制使受扰动输入能回归原平衡状态,从而提升对对抗扰动的鲁棒性。为避免使用额外数据,我们通过采样分布内特征空间低似然区域生成虚假的OOD嵌入,近似真实分布外数据的边界。为进一步增强鲁棒性,我们在稳定特征空间后引入正交二值层,最大化ID与OOD平衡点间的分离距离。大量实验验证了该方法在多个基准上的优越性能,尤其在对抗攻击下表现突出:在CIFAR-10 vs. CIFAR-100上,鲁棒检测准确率从37.8%提升至80.1%;在CIFAR-100 vs. CIFAR-10上,从29.0%提升至67.0%。

原文摘要 · Abstract (English)

Despite significant advancements in out-of-distribution (OOD) detection, existing methods still struggle to maintain robustness against adversarial attacks, compromising their reliability in critical real-world applications. Previous studies have attempted to address this challenge by exposing detectors to auxiliary OOD datasets alongside adversarial training. However, the increased data complexity inherent in adversarial training, and the myriad of ways that OOD samples can arise during testing, often prevent these approaches from establishing robust decision boundaries. To address these limitations, we propose AROS, a novel approach leveraging neural ordinary differential equations (NODEs) with Lyapunov stability theorem in order to obtain robust embeddings for OOD detection. By incorporating a tailored loss function, we apply Lyapunov stability theory to ensure that both in-distribution (ID) and OOD data converge to stable equilibrium points within the dynamical system. This approach encourages any perturbed input to return to its stable equilibrium, thereby enhancing the model's robustness against adversarial perturbations. To not use additional data, we generate fake OOD embeddings by sampling from low-likelihood regions of the ID data feature space, approximating the boundaries where OOD data are likely to reside. To then further enhance robustness, we propose the use of an orthogonal binary layer following the stable feature space, which maximizes the separation between the equilibrium points of ID and OOD samples. We validate our method through extensive experiments across several benchmarks, demonstrating superior performance, particularly under adversarial attacks. Notably, our approach improves robust detection performance from 37.8% to 80.1% on CIFAR-10 vs. CIFAR-100 and from 29.0% to 67.0% on CIFAR-100 vs. CIFAR-10.

异常检测对抗鲁棒性动态系统嵌入学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。