arXiv:2512.13421cs.CV2025-12被引 5

通过流匹配提升视觉编码器语义,实现高维潜空间的高质量图像生成。

RecTok: Reconstruction Distillation along Rectified Flow

  • 用流匹配的前向轨迹承载语义信息,替代传统低维潜空间
  • 在无分类器引导下,gFID-50K达当前最优,且潜空间维度越高越好
  • 适合追求高语义表达与生成质量平衡的研究者

视觉分词器在扩散模型中至关重要。潜空间维度影响重建保真度与语义表达能力,但二者存在固有权衡,导致现有方法受限于低维潜空间。尽管近期工作利用视觉基础模型增强分词器语义并加速收敛,高维分词器仍逊于低维版本。本文提出RecTok,通过两项创新突破高维分词器瓶颈:流语义蒸馏与重建对齐蒸馏。核心思想是让流匹配中的前向流具备丰富语义,作为扩散变压器的训练空间,而非局限于潜空间。具体地,将视觉基础模型(VFM)的语义信息蒸馏至流匹配的轨迹中,并引入掩码特征重建损失进一步增强语义。RecTok在重建、生成质量和判别性能上均表现优异,在gFID-50K指标下无论是否使用分类器自由引导均达到当前最优,同时保持语义丰富的潜空间结构。随着潜维度增加,性能持续提升。代码与模型已公开。

原文摘要 · Abstract (English)

Visual tokenizers play a crucial role in diffusion models. The dimensionality of latent space governs both reconstruction fidelity and the semantic expressiveness of the latent feature. However, a fundamental trade-off is inherent between dimensionality and generation quality, constraining existing methods to low-dimensional latent spaces. Although recent works have leveraged vision foundation models to enrich the semantics of visual tokenizers and accelerate convergence, high-dimensional tokenizers still underperform their low-dimensional counterparts. In this work, we propose RecTok, which overcomes the limitations of high-dimensional visual tokenizers through two key innovations: flow semantic distillation and reconstruction--alignment distillation. Our key insight is to make the forward flow in flow matching semantically rich, which serves as the training space of diffusion transformers, rather than focusing on the latent space as in previous works. Specifically, our method distills the semantic information in VFMs into the forward flow trajectories in flow matching. And we further enhance the semantics by introducing a masked feature reconstruction loss. Our RecTok achieves superior image reconstruction, generation quality, and discriminative performance. It achieves state-of-the-art results on the gFID-50K under both with and without classifier-free guidance settings, while maintaining a semantically rich latent space structure. Furthermore, as the latent dimensionality increases, we observe consistent improvements. Code and model are available at https://shi-qingyu.github.io/rectok.github.io.

扩散模型流匹配高维潜空间语义蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。