arXiv:2505.19459cs.LGcs.AI2025-05中稿 · CVPR被引 1

提出新框架,让模型同时具备分类准、抗攻击强、能生成图像的能力。

Your Classifier Can Do More: Towards Balancing the Gaps in Classification, Robustness, and Generation

  • 通过能量分布对齐,统一优化干净样本、对抗样本和生成样本的分布
  • 在多个数据集上实现顶尖鲁棒性,同时保持高准确率和良好生成质量
  • 适合需要兼顾分类、安全性和生成能力的研究与应用

联合能量模型(JEM)虽能统一分类与生成,但鲁棒性远低于对抗训练(AT),而后者虽鲁棒性强却牺牲了干净准确率且无生成能力。这一分类、鲁棒性与生成能力之间的三难困境引发了根本问题:能否单模型实现三者兼得?我们系统分析了不同JEM与AT变体中干净、对抗及生成样本的能量景观,发现AT缩小了干净与对抗样本的能量差距,而JEM则缩小了干净与合成样本的差距。由此提出能量基联合分布对抗训练(EB-JDAT),通过新颖的极小极大能量优化,显式对齐三类样本的能量分布。在CIFAR-10、CIFAR-100及ImageNet子集上的实验表明,EB-JDAT在保持接近原始准确率的同时,实现了最先进的鲁棒性,并具备与JEM相当的生成性能,有效突破了三者间的权衡边界。代码已开源。

原文摘要 · Abstract (English)

Joint Energy-based Models (JEMs) are well known for their ability to unify classification and generation within a single framework. Despite their promising generative and discriminative performance, their robustness remains far inferior to adversarial training (AT), which, conversely, achieves strong robustness but sacrifices clean accuracy and lacks generative ability. This inherent trilemma-balancing classification accuracy, robustness, and generative capability-raises a fundamental question: Can a single model achieve all three simultaneously? To answer this, we conduct a systematic energy landscape analysis of clean, adversarial, and generated samples across various JEM and AT variants. We observe that AT reduces the energy gap between clean and adversarial samples, while JEMs narrow the gap between clean and synthetic ones. This observation suggests a key insight: if the energy distributions of all three data types can be aligned, we might bridge their performance disparities. Building on this idea, we propose Energy-based Joint Distribution Adversarial Training (EB-JDAT), a unified generative-discriminative-robust framework that maximizes the joint probability of clean and adversarial distribution. EB-JDAT introduces a novel min-max energy optimization to explicitly aligning energies across clean, adversarial, and generated samples. Extensive experiments on CIFAR-10, CIFAR-100, and ImageNet subsets demonstrate that EB-JDAT achieves state-of-the-art robustness while maintaining near-original accuracy and competitive generation quality of JEMs, effectively achieving a new trade-off frontier between accuracy, robustness, and generation. The code is released at https://github.com/yujkc/EB-JDAT.

生成模型鲁棒性能量模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。