arXiv:2508.05599cs.CV2025-08被引 8

WeTok通过分组无查表量化与生成解码器,实现高保真图像重建。

WeTok: Powerful Discrete Tokenization for High-Fidelity Visual Reconstruction

  • 分组无查表量化提升编码效率,支持更大码本扩展。
  • 在400倍压缩下零样本rFID达0.12,优于主流连续令牌化方法。
  • 适合追求高压缩比与高视觉保真度的生成模型研究者。

视觉令牌化是视觉生成的关键组件,但现有方法常在压缩率与重建保真度之间难以平衡。为此,我们提出强大的WeTok令牌化器,通过两项核心创新超越此前领先方法:(1) 分组无查表量化(GQ)。将潜在特征分组后对每组进行无查表量化,有效克服先前令牌化器的内存与计算瓶颈,同时实现更高可扩展码本的重建突破;(2) 生成解码器(GD)。不同于传统方法,引入带有额外噪声先验的生成解码器,使WeTok能基于离散令牌概率建模视觉数据分布,从而在高压缩下仍保留细节。在ImageNet 50k验证集上,于高保真设定下,WeTok以400×压缩比达成0.12的零样本rFID,显著优于FLUX-VAE(0.18)和SD-VAE 3.5(0.19)。在高压缩场景中,768×压缩比下零样本rFID为3.49,远超仅50%压缩比的Cosmos(4.57)。代码与模型已开源:https://github.com/zhuangshaobin/WeTok。

原文摘要 · Abstract (English)

Visual tokenizer is a critical component for vision generation. However, the existing tokenizers often face unsatisfactory trade-off between compression ratios and reconstruction fidelity. To fill this gap, we introduce a powerful and concise WeTok tokenizer, which surpasses the previous leading tokenizers via two core innovations. (1) Group-wise lookup-free Quantization (GQ). We partition the latent features into groups, and perform lookup-free quantization for each group. As a result, GQ can efficiently overcome memory and computation limitations of prior tokenizers, while achieving a reconstruction breakthrough with more scalable codebooks. (2) Generative Decoder (GD). Different from prior tokenizers, we introduce a generative decoder with a prior of extra noise variable. In this case, GD can probabilistically model the distribution of visual data conditioned on discrete tokens, allowing WeTok to reconstruct visual details, especially at high compression ratio. On the ImageNet 50k validation set, at a high-fidelity setting, WeTok achieves a record-low zero-shot rFID of 0.12, outperforming leading continuous tokenizers like FLUX-VAE (0.18) and SD-VAE 3.5 (0.19) with 400% compression ratio. Furthermore, in a high-compression regime, WeTok achieves a zero-shot rFID of 3.49 at a 768$\times$ compression ratio, substantially surpassing Cosmos, which scores 4.57 at only 50% our compression ratio. Code and models are available: https://github.com/zhuangshaobin/WeTok.

视觉重建离散令牌化压缩比生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。