arXiv:2510.12231cs.CV2025-10

通过双向迭代修正生成图像,提升效率与质量

BIGFix: Bidirectional Image Generation with Token Fixing

  • 引入随机令牌注入训练,实现生成过程中的自修正
  • 在ImageNet-256等数据集上显著提升图像生成质量
  • 适合关注高效高质图像/视频生成的研究者

近期图像与视频生成技术发展迅速,但推理效率仍是关键挑战。现有方法虽通过每步并行预测多个标记提升速度,但易因标记不兼容导致结构不一致。传统方法一旦采样即无法回溯修正错误。本文提出一种双向图像生成方法BIGFix,通过在训练中注入随机标记,增强模型鲁棒性,使采样时可迭代修正错误标记。该方法在保持并行预测高效性的前提下,显著提升生成质量。我们在ImageNet-256和CIFAR-10图像生成任务,以及UCF-101和NuScenes视频生成任务上验证了该方法,均取得显著改进。

原文摘要 · Abstract (English)

Recent advances in image and video generation have raised significant interest from both academia and industry. A key challenge in this field is improving inference efficiency, as model size and the number of inference steps directly impact the commercial viability of generative models while also posing fundamental scientific challenges. A promising direction involves combining auto-regressive sequential token modeling with multi-token prediction per step, reducing inference time by up to an order of magnitude. However, predicting multiple tokens in parallel can introduce structural inconsistencies due to token incompatibilities, as capturing complex joint dependencies during training remains challenging. Traditionally, once tokens are sampled, there is no mechanism to backtrack and refine erroneous predictions. We propose a method for self-correcting image generation by iteratively refining sampled tokens. We achieve this with a novel training scheme that injects random tokens in the context, improving robustness and enabling token fixing during sampling. Our method preserves the efficiency benefits of parallel token prediction while significantly enhancing generation quality. We evaluate our approach on image generation using the ImageNet-256 and CIFAR-10 datasets, as well as on video generation with UCF-101 and NuScenes, demonstrating substantial improvements across both modalities.

图像生成自修正并行采样

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。