通过熵值评估置信度,提升自回归图像生成的效率与稳定性。
ScalingAR: Scaling Confidence for Autoregressive Image Generation
- 用令牌熵作置信度信号,分层次动态调整生成路径。
- 在GenEval和TIIF-Bench上分别提升12.5%和15.2%性能。
- 无需外部奖励或提前解码,显著降低视觉令牌消耗62%。
测试时策略在大型语言模型中表现卓越,但在基于下一个标记预测(NTP)的自回归图像生成领域仍鲜有探索。现有视觉自回归模型的测试时扩展方法依赖频繁的部分解码和外部奖励模型,对NTP图像生成因中间结果不稳定而效率低且效果差。为此,我们提出ScalingAR,一种专为NTP自回归图像生成设计的测试时扩展框架。ScalingAR引入令牌熵作为置信度信号,在两个互补层面运作:(i) 配置层,融合内在不确定性和条件利用性构建统一置信状态;(ii) 策略层,利用该状态实现自适应轨迹剪枝与动态引导调度。无需早期解码或辅助奖励,ScalingAR在多个基准上取得显著提升:(I) 在GenEval上提升12.5%,在TIIF-Bench上提升15.2%;(II) 视觉令牌消耗减少62.0%的同时超越基线;(III) 增强鲁棒性,在挑战场景中缓解性能下降26.0%。这些结果确立了ScalingAR作为高效可靠的自回归图像生成测试时扩展方案。
原文摘要 · Abstract (English)
Test-time strategies have shown remarkable success in improving large language models, but their application to next-token prediction (NTP) autoregressive (AR) image generation remains largely underexplored. Existing test-time scaling (TTS) methods for visual autoregressive models (VAR) rely on frequent partial decoding and external reward models, which are inefficient and often ineffective for NTP-based image generation due to the inherent instability of intermediate decoding results. To address these limitations, we propose ScalingAR, a novel test-time scaling framework tailored for NTP-based AR image generation. ScalingAR introduces token entropy as a confidence signal and operates at two complementary levels: (i) Profile Level, integrates intrinsic uncertainty and conditional utilization into a unified confidence state, and (ii) Policy Level, leverages this state for adaptive trajectory pruning and dynamic guidance scheduling. Without requiring early decoding or auxiliary rewards, ScalingAR achieves significant improvements across diverse benchmarks. Experiments show that ScalingAR (I) improves base models by $12.5\%$ on GenEval and $15.2\%$ on TIIF-Bench, (II) reduces visual token consumption by $62.0\%$ while outperforming baselines, and (III) enhances robustness, mitigating performance degradation by $26.0\%$ in challenging scenarios. These results establish ScalingAR as a robust and efficient test-time scaling solution for autoregressive image generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。