利用预训练隐空间的近似高斯混合结构,实现可证明鲁棒性。
Certified Robustness from Approximate Gaussian Mixture Structures in Pretrained Latent Spaces

- 基于隐空间近似高斯混合结构设计可证明鲁棒分类器。
- 在CIFAR-10和ImageNet上达到最优或竞争性认证准确率。
- 兼容预训练模型,计算开销低,适合实际部署场景。
深度学习模型易受对抗扰动影响,威胁安全关键应用。尽管经验防御在实践中表现良好,但缺乏形式化保证;而现有可证明鲁棒方法常因无法利用复杂数据分布结构而导致保守性过强。本文提出一种新框架,利用数据表示中的隐空间结构设计可证明鲁棒分类器。首先分析高斯混合设置,推导出鲁棒分类器存在的充要条件,并构造具有闭式鲁棒性证书与泛化保证的分类器。核心贡献在于:即使预训练编码器映射后的隐分布仅在KL散度上与高斯混合$ε$-接近,仍可保证认证准确率随$ε$平滑下降,且给出明确的界。该结果使预训练模型可直接使用,无需严格分布假设。实验表明,该方法在CIFAR-10和ImageNet上达到当前最优或有竞争力的认证准确率,同时保持高干净精度和低计算开销。整体工作确立了近似隐结构作为可证明鲁棒性的实用且原理性路径。
原文摘要 · Abstract (English)
Deep learning models are vulnerable to adversarial perturbations, raising important concerns for safety-critical deployment. Empirical defenses can achieve strong robustness in practice, but lack formal guarantees, motivating the need for certifiably robust classifiers. While certified methods provide formal guarantees, they often yield overly conservative bounds due to their inability to exploit structure in complex data distributions. In this work, we propose a framework for designing certifiably robust classifiers that leverages latent structure in data representations. We first analyze the Gaussian mixture setting, deriving necessary and sufficient conditions for the existence of robust classifiers and constructing a classifier with a closed-form robustness certificate and generalization guarantees. Our main contribution is to show that exact structure is not required: we prove that if a pretrained encoder maps inputs to a latent distribution that is $\varepsilon$-close (in KL divergence) to a Gaussian mixture, then certified accuracy degrades gracefully, with an explicit bound relating robustness under the true and approximate distributions. This result enables the direct use of pretrained models without requiring exact distributional assumptions. Empirically, our method achieves state-of-the-art or competitive certified accuracy on CIFAR-10 and ImageNet, while maintaining strong clean performance and low computational overhead. Overall, our work establishes approximate latent structure as a practical and principled route to certifiable robustness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。