用对抗诊断提升图像自回归生成的清晰度和结构一致性
Adversarial Error Correction for Visual Autoregressive Generation

- 引入对抗性诊断模块,在每级尺度间主动检测并修正误差
- 在不增加训练成本的情况下,FID降低16%,参数仅增3%
- 适合希望无损优化已有图像生成模型的研究者
视觉自回归(VAR)模型通过分层逐尺度预测实现图像生成,但易受误差传播影响,细微的粗粒度错误会逐级放大,导致最终合成结果失真。为此,我们提出AID-VAR,一种即插即用的增强框架,通过对抗性注入诊断提升预训练VAR模型。不同于传统被动生成,AID-VAR借鉴GAN的对抗反馈机制,部署判别器在每级尺度转换时诊断真实分布差距,并结合轻量级引导注入模块,非侵入式地优化冻结的VAR主干特征空间,有效引导生成向真实图像分布靠拢,且不破坏原有潜空间。为严谨评估跨尺度一致性,我们提出新指标——尺度间一致性分数(ISCS),量化相邻分辨率间的保真度与结构对齐程度。实验表明,AID-VAR在多种主干模型上均显著提升纹理清晰度与结构准确性,且开销极小:例如AID-VAR-d20在参数仅增加3%的情况下,FID降低16%。该方法为大规模VAR生成器提供高效、可扩展的升级路径,无需修改训练数据、基础架构或采样策略即可增强全局连贯性与局部细节。代码已开源。
原文摘要 · Abstract (English)
Visual Autoregressive (VAR) models have emerged as a powerful paradigm for image synthesis by performing hierarchical next-scale prediction. However, VAR models are inherently prone to cascading error propagation, where subtle coarse-scale mispredictions are amplified across the hierarchy, ultimately distorting the final synthesis. To mitigate this, we propose AID-VAR, a plug-and-play framework that enhances pre-trained VARs through Adversarially Injected Diagnosis. Instead of a standard passive generation, AID-VAR introduces a proactive error-correction mechanism inspired by the adversarial feedback in GANs. We deploy a discriminator to diagnose fidelity gaps at each scale transition, coupled with a lightweight guidance injector. This module operates as a non-invasive adapter that refines the feature manifold of a frozen VAR backbone, effectively steering the generation toward the distribution of real images without destabilizing the pre-trained latent space. Furthermore, to rigorously evaluate this cross-scale progression, we introduce the Inter-Scale Consistency Score (ISCS), a novel metric that quantifies the fidelity and structural alignment between consecutive resolution scales. Experimental results across various backbones demonstrate that AID-VAR delivers sharper textural details and fewer structural distortions with negligible overhead. For instance, AID-VAR-d20 achieves a 16% improvement in FID with only a 3% increase in parameters. These results establish AID-VAR as a highly efficient and scalable pathway for upgrading large-scale VAR generators, enhancing global coherence and local detail without altering training data, base architectures, or sampling schedules. Code is available at https://github.com/bijiw515/AID-VAR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。