通过能量函数实现可解释的图像生成,支持组合概念控制。
CoBELa: Steering Transparent Generation via Concept Bottlenecks on Energy Landscapes
- 用概念能量函数替代黑箱解码器,直接在预训练生成器潜空间中引导生成。
- 在CelebA-HQ和CUB-200-2011上实现75.70%/82.42%概念准确率,FID达6.47/5.37。
- 无需重训练,可灵活进行概念组合与否定,适合需要可控生成的研究者。
生成式概念瓶颈模型旨在通过显式用户可操作的概念来实现可解释的生成。然而,以往方法常依赖非显式的瓶颈表示(如视觉线索或不透明的概念嵌入)或黑箱解码器以保持图像质量,削弱了透明性。本文提出CoBELa(能量景观上的概念瓶颈),一种无需解码器、基于能量的框架,通过冻结的预训练生成器潜空间中的每概念能量函数完全条件化生成,无需生成器重训练,支持事后解释。由于概念能量可加性组合,CoBELa天然支持复合概念干预:概念合取与否定通过叠加或减去各概念能量项实现,无需额外训练。扩散调度的能量引导策略取代昂贵的MCMC链,采用更稳定的分步去噪机制,实现高效的概念引导采样。在CelebA-HQ和CUB-200-2011上的实验表明,其性能优于现有概念瓶颈生成模型,分别达到75.70%/82.42%的概念准确率和6.47/5.37的FID,同时支持可靠的多概念干预。
原文摘要 · Abstract (English)
Generative concept bottleneck models aim to enable interpretable generation by routing synthesis through explicit, user-facing concepts. In practice, prior approaches often rely on non-explicit bottleneck representations (e.g., vision cues or opaque concept embeddings) or black-box decoders to preserve image quality, which weakens the transparency. We propose CoBELa (Concept Bottlenecks on Energy Landscapes), a decoder-free, energy-based framework that eliminates non-explicit bottleneck representations by conditioning generation entirely through per-concept energy functions over the latent space of a frozen pretrained generator-requiring no generator retraining and enabling post-hoc interpretation. Because these concept energies compose additively, CoBELa naturally supports compositional concept interventions: concept conjunction and negation are realized by summing or subtracting per-concept energy terms without additional training. A diffusion-scheduled energy guidance scheme further replaces expensive MCMC chains with more stable, scheduled denoising for efficient concept-steered sampling. Experiments on CelebA-HQ and CUB-200-2011 demonstrate improvements over prior concept bottleneck generative models, achieving 75.70%/82.42% concept accuracy and 6.47/5.37 FID, respectively, while enabling reliable multi-concept interventions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。