提出特征空间平滑方法,让模型在对抗攻击下仍保持特征一致性。
Feature-Space Smoothing: Certified Robustness of Deep Representations
- 通过特征空间平滑构建可认证鲁棒性的表示,抵御l2有界扰动。
- 新提出的特征余弦相似度下界在强白盒攻击下显著提升任务性能。
- 无需重训练即可接入多模态大模型,适合追求可靠性的实际应用。
现代深度学习模型在多种应用中表现强劲,但对导致特征空间扭曲的恶意输入仍易产生错误预测。为此,我们提出特征空间平滑(FS),一种通用防御框架,可在特征表示层面提供可认证的鲁棒性。我们证明,FS能将给定的特征编码器转化为平滑版本,在l_2有界扰动下保证干净与对抗特征间的余弦相似度具有可认证的下界。进一步建立该特征余弦相似度下界(FCSB)在余弦相似度度量下的预测级认证,并指出其值由编码器内在的高斯鲁棒性得分决定。基于此,我们引入高斯平滑增强模块(GSB),一个即插即用组件,用于提升编码器的高斯鲁棒性得分。该模块能增强特征空间一致性并保持下游任务的特征效用,实现对受保护模型(如多模态大语言模型MLLMs)的无缝集成,无需额外训练或对齐,同时提升鲁棒性并保留下游任务解码性能。大量实验表明,集成FS在多种模型与应用中持续提供非平凡的可认证鲁棒性,并显著提升强白盒对抗攻击下的任务性能。
原文摘要 · Abstract (English)
Modern deep learning models exhibit strong capabilities across diverse applications, yet remain vulnerable to malicious inputs that induce erroneous predictions via feature-space distortion. To address this vulnerability, we propose Feature-space Smoothing (FS), a general defense framework that provides certified robustness at the feature representation level. We show that FS converts a given feature encoder into a smoothed variant that is guaranteed to maintain a certified lower bound on the cosine similarity between clean and adversarial features under l_2-bounded perturbations. We then establish that this Feature Cosine Similarity Bound (FCSB) can be extended to the prediction-wise certification under the cosine similarity measure, and the value of FCSB is determined by the encoder intrinsic Gaussian robustness score. Building on those insights, we introduce the Gaussian Smoothness Booster (GSB), a plug-and-play module to improve the encoder Gaussian robustness score. Specifically, the GSB module is plugged to enhance the feature-space consistency and maintain the feature utility for downstream tasks under Gaussian perturbations. This design enables seamless integration of FS on the protected model, e.g., Multimodal Large Language Models (MLLMs), without additional model retraining or alignment, improving its robustness while preserving the performance for downstream task-oriented decoding. Extensive experiments demonstrate that integrating FS consistently provides non-trivial certified robustness and significantly improves task-oriented performance under strong white-box adversarial attacks across diverse models and applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。