arXiv:2511.21185cs.CVcs.AI2025-11被引 2

通过分块生成与布局重构,提升图像自回归模型的测试时扩展效果。

Progress by Pieces: Test-Time Scaling for Autoregressive Image Generation

  • 分块渐进生成,多候选并行评估,早期剪枝无效路径。
  • N=4时性能超越N=8的Best-of-N,质量提升14.4%,成本降25.6%。
  • 适用于图文生成与编辑,增强语义保真度,适合追求高效高质生成场景。

近期视觉自回归(AR)模型在文本到图像生成中展现出潜力,其行为类似大语言模型。尽管测试时计算扩展已在自然语言任务中带来显著成效,但其在视觉AR模型中的应用仍待探索,且面临独特挑战。直接套用如Best-of-N等策略效率低下:错误生成路径仍消耗完整计算资源,而栅格扫描解码缺乏整体画面蓝图,导致仅生成少数符合提示的候选结果。为此,我们提出GridAR,一种测试时扩展框架,旨在从视觉自回归模型中挖掘最佳输出。GridAR采用网格分区渐进生成机制,在画布同一位置生成多个部分候选,早期剔除不可行项,并将可行项固定为锚点引导后续解码。同时,提出布局指定提示重写策略,通过局部视图推断合理布局以满足提示要求。经重写后的提示引导后续生成,缓解蓝图缺失问题。联合使用后,GridAR在有限测试时扩展下实现更高质量结果:当N=4时,于T2I-CompBench++上超越Best-of-N(N=8)达14.4%,且成本降低25.6%。该方法亦可泛化至自回归图像编辑,在PIE-Bench上达到相当的编辑质量,语义保真度提升13.9%优于更大N基线。

原文摘要 · Abstract (English)

Recent visual autoregressive (AR) models have shown promising capabilities in text-to-image generation, operating in a manner similar to large language models. While test-time computation scaling has brought remarkable success in enabling reasoning-enhanced outputs for challenging natural language tasks, its adaptation to visual AR models remains unexplored and poses unique challenges. Naively applying test-time scaling strategies such as Best-of-N can be suboptimal: they consume full-length computation on erroneous generation trajectories, while the raster-scan decoding scheme lacks a blueprint of the entire canvas, limiting scaling benefits as only a few prompt-aligned candidates are generated. To address these, we introduce GridAR, a test-time scaling framework designed to elicit the best possible results from visual AR models. GridAR employs a grid-partitioned progressive generation scheme in which multiple partial candidates for the same position are generated within a canvas, infeasible ones are pruned early, and viable ones are fixed as anchors to guide subsequent decoding. Coupled with this, we present a layout-specified prompt reformulation strategy that inspects partial views to infer a feasible layout for satisfying the prompt. The reformulated prompt then guides subsequent image generation to mitigate the blueprint deficiency. Together, GridAR achieves higher-quality results under limited test-time scaling: with N=4, it even outperforms Best-of-N (N=8) by 14.4% on T2I-CompBench++ while reducing cost by 25.6%. It also generalizes to autoregressive image editing, showing comparable edit quality and a 13.9% gain in semantic preservation on PIE-Bench over larger-N baselines.

图像生成自回归模型测试时扩展提示优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。