arXiv:2510.13872cs.LGcs.AI2025-10被引 1

用对抗训练统一提升模型分类鲁棒性与生成质量。

Scalable Energy-Based Models via Adversarial Training: Unifying Discrimination and Generation

  • 以对抗样本替代SGLD,通过BCE损失优化能量函数
  • 在ImageNet上实现高分辨率生成与顶尖分类性能
  • 兼具生成能力与抗攻击性,适合可信AI场景

在单一框架中同时实现稳健分类与高保真生成建模仍是重大挑战。混合方法如联合能量模型(JEM)将分类器视为能量模型,但常受基于随机梯度朗之万动力学(SGLD)训练的不稳定性与生成质量差的限制。本文提出一种新型训练框架,融合对抗训练(AT)思想,兼顾判别鲁棒性与稳定生成学习。方法包含三项创新:(1) 用稳定的对抗训练替代SGLD-based JEM学习,通过二元交叉熵(BCE)损失区分真实数据与由投影梯度下降(PGD)生成的对比样本;(2) 对判别部分引入对抗训练,增强分类鲁棒性,同时隐式提供训练所需的梯度正则化;(3) 采用两阶段训练策略,缓解归一化不稳定性,并可复用预训练鲁棒分类器,适用于多种架构。在CIFAR-10/100和ImageNet上的实验表明:(1) 本方法首次实现高分辨率数据集上的稳定扩展,在ImageNet 256x256上同时达到顶尖判别与生成性能;(2) 首次将生成质量与对抗鲁棒性结合,支持可信反事实解释;(3) 可作为独立生成模型使用,性能媲美自回归模型,超越扩散模型,且更具灵活性。

原文摘要 · Abstract (English)

Simultaneously achieving robust classification and high-fidelity generative modeling within a single framework presents a significant challenge. Hybrid approaches, such as Joint Energy-Based Models (JEM), interpret classifiers as EBMs but are often limited by the instability and poor sample quality inherent in training based on Stochastic Gradient Langevin Dynamics (SGLD). We address these limitations by proposing a novel training framework that integrates adversarial training (AT) principles for both discriminative robustness and stable generative learning. The proposed method introduces three key innovations: (1) the replacement of SGLD-based JEM learning with a stable, AT-based approach that optimizes the energy function through a Binary Cross-Entropy (BCE) loss that discriminates between real data and contrastive samples generated via Projected Gradient Descent (PGD); (2) adversarial training for the discriminative component that enhances classification robustness while implicitly providing the gradient regularization needed for stable EBM training; and (3) a two-stage training strategy that addresses normalization-related instabilities and enables leveraging pretrained robust classifiers, generalizing effectively across architectures. Experiments on CIFAR-10/100 and ImageNet demonstrate that our approach: (1) is the first EBM-based hybrid to scale to high-resolution datasets with high training stability, simultaneously achieving state-of-the-art discriminative and generative performance on ImageNet 256x256; (2) uniquely combines generative quality with adversarial robustness, enabling faithful counterfactual explanations; and (3) functions as a competitive standalone generative model, matching autoregressive models and surpassing diffusion models while offering additional versatility.

能量模型对抗训练生成模型鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。