arXiv:2604.13030cs.CV2026-04被引 2

提出生成精炼网络,让图像生成更高效且质量更高。

Generative Refinement Networks for Visual Synthesis

  • 用分层二值量化解决离散化瓶颈,接近无损重建。
  • 在ImageNet上实现0.56 rFID图像重建与1.81 gFID条件生成新纪录。
  • 支持复杂度自适应生成,适合高阶图文/视频生成研究者。

尽管扩散模型主导视觉生成领域,但其计算效率低,对所有内容投入相同算力。相反,自回归(AR)模型天然具备复杂度感知能力,但受限于有损离散分词和误差累积。本文提出生成精炼网络(GRN),突破上述瓶颈:通过理论近无损的分层二值量化(HBQ)解决离散化问题,重建质量媲美连续方法;基于HBQ隐空间构建全局精炼机制,逐步修正和完善图像,类比人类艺术家创作过程;同时引入熵引导采样策略,实现复杂度自适应、可变步长生成,不牺牲视觉质量。在ImageNet基准上,GRN创下0.56 rFID图像重建与1.81 gFID类别条件生成新纪录。我们还将GRN扩展至更具挑战性的文本到图像和文本到视频生成任务,在同等规模下表现更优。相关模型与代码已开源,推动该方向进一步研究。

原文摘要 · Abstract (English)

While diffusion models dominate the field of visual generation, they are computationally inefficient, applying a uniform computational effort regardless of different complexity. In contrast, autoregressive (AR) models are inherently complexity-aware, as evidenced by their variable likelihoods, but are often hindered by lossy discrete tokenization and error accumulation. In this work, we introduce Generative Refinement Networks (GRN), a next-generation visual synthesis paradigm that addresses these issues. At its core, GRN addresses the discrete tokenization bottleneck through a theoretically near-lossless Hierarchical Binary Quantization (HBQ), achieving a reconstruction quality comparable to continuous counterparts. Built upon HBQ's latent space, GRN fundamentally upgrades AR generation with a global refinement mechanism that progressively perfects and corrects artworks -- like a human artist painting. Besides, GRN integrates an entropy-guided sampling strategy, enabling complexity-aware, adaptive-step generation without compromising visual quality. On the ImageNet benchmark, GRN establishes new records in image reconstruction (0.56 rFID) and class-conditional image generation (1.81 gFID). We also scale GRN to more challenging text-to-image and text-to-video generation, delivering superior performance on an equivalent scale. We release all models and code to foster further research on GRN.

图像生成自回归模型量化精炼网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。