arXiv:2511.14184cs.CV2025-11AAAI被引 1

通过全局关系建模,让图像令牌分布更均匀,提升生成质量。

GloTok: Global Perspective Tokenizer for Image Reconstruction and Generation

  • 用全局关系学习优化令牌语义分布,避免局部监督偏差。
  • 在ImageNet-1k上实现最优重建性能与生成质量。
  • 适合需要高质量图像生成的自回归模型训练场景。

现有先进图像分词方法利用预训练视觉模型的多样化语义特征进行额外监督,以扩展潜在表示分布,从而提升图像重建与生成质量。这些方法采用局部监督策略,限制了语义分布的一致性。然而,VA-VAE表明更均匀的特征分布能带来更好的生成表现。本文提出全局视角分词器(GloTok),利用全局关系信息建模更均匀的令牌语义分布。具体而言,提出一种基于码本直方图的关系学习方法,将预训练模型在全数据集上建模的语义信息迁移至语义码本;同时设计残差学习模块,恢复细粒度细节,以最小化量化带来的重建误差。通过上述设计,GloTok实现了更均匀分布的语义潜在表示,支持自回归模型训练生成高质量图像,且无需在训练过程中直接访问预训练模型。在标准ImageNet-1k基准上的实验表明,该方法在重建性能和生成质量上均达到当前最优水平。

原文摘要 · Abstract (English)

Existing state-of-the-art image tokenization methods leverage diverse semantic features from pre-trained vision models for additional supervision, to expand the distribution of latent representations and thereby improve the quality of image reconstruction and generation. These methods employ a locally supervised approach for semantic supervision, which limits the uniformity of semantic distribution. However, VA-VAE proves that a more uniform feature distribution yields better generation performance. In this work, we introduce a Global Perspective Tokenizer (GloTok), which utilizes global relational information to model a more uniform semantic distribution of tokenized features. Specifically, a codebook-wise histogram relation learning method is proposed to transfer the semantics, which are modeled by pre-trained models on the entire dataset, to the semantic codebook. Then, we design a residual learning module that recovers the fine-grained details to minimize the reconstruction error caused by quantization. Through the above design, GloTok delivers more uniformly distributed semantic latent representations, which facilitates the training of autoregressive (AR) models for generating high-quality images without requiring direct access to pre-trained models during the training process. Experiments on the standard ImageNet-1k benchmark clearly show that our proposed method achieves state-of-the-art reconstruction performance and generation quality.

图像生成分词器自回归

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。