用置信预测提升模型抗攻击能力,确保高风险场景下可靠预测。
Enhancing Adversarial Robustness with Conformal Prediction: A Framework for Guaranteed Model Reliability
- 引入OPSA攻击法最大化模型不确定性,测试防御弱点。
- 提出OPSA-AT防御框架,在多种攻击下显著提升鲁棒性。
- 适合安全关键领域需可靠预测的深度学习应用。
随着深度学习模型在高风险场景中的广泛应用,对抗攻击的鲁棒性防御与可靠的性能保证变得至关重要。仅凭准确率无法提供充分保障或可信的不确定性估计。本文通过融合置信预测(Conformal Prediction)原理,改进对抗训练:提出一种名为OPSA(OPtimal Size Attack)的对抗攻击方法,旨在任意显著性水平下通过最大化模型不确定性来降低置信预测效率,且无需覆盖保证。相应地,提出OPSA-AT(Adversarial Training)防御策略,将OPSA融入新型置信训练范式。实验表明,相比基线方法,OPSA攻击诱导出更高的不确定性;而OPSA-AT防御模型不仅对OPSA及其他攻击具有更强鲁棒性,还能维持可靠的预测结果。研究证明该集成方法在构建可信、韧性的深度学习模型方面有效,适用于安全关键领域。代码已公开于 https://github.com/bjbbbb/Enhancing-Adversarial-Robustness-with-Conformal-Prediction。
原文摘要 · Abstract (English)
As deep learning models are increasingly deployed in high-risk applications, robust defenses against adversarial attacks and reliable performance guarantees become paramount. Moreover, accuracy alone does not provide sufficient assurance or reliable uncertainty estimates for these models. This study advances adversarial training by leveraging principles from Conformal Prediction. Specifically, we develop an adversarial attack method, termed OPSA (OPtimal Size Attack), designed to reduce the efficiency of conformal prediction at any significance level by maximizing model uncertainty without requiring coverage guarantees. Correspondingly, we introduce OPSA-AT (Adversarial Training), a defense strategy that integrates OPSA within a novel conformal training paradigm. Experimental evaluations demonstrate that our OPSA attack method induces greater uncertainty compared to baseline approaches for various defenses. Conversely, our OPSA-AT defensive model significantly enhances robustness not only against OPSA but also other adversarial attacks, and maintains reliable prediction. Our findings highlight the effectiveness of this integrated approach for developing trustworthy and resilient deep learning models for safety-critical domains. Our code is available at https://github.com/bjbbbb/Enhancing-Adversarial-Robustness-with-Conformal-Prediction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。