arXiv:2511.22242cs.CV2025-11被引 2

提升流匹配生成模型的测试时计算效率,实现更优图像生成效果。

Rethinking Test Time Scaling for Flow-Matching Generative Models

  • 引入分词级多样性机制与噪声感知奖励优化,增强搜索多样性。
  • 在相同算力下,性能比现有最佳方法提升近一倍。
  • 适合追求高精度图像生成的开发者与研究者使用。

文本到图像扩散模型在测试时可通过扩大计算量,搜索使给定奖励函数最大化的生成图像来提升性能。尽管现有轨迹级探索方法对标准扩散模型有效,但难以适配采用确定性采样的现代流匹配模型,导致局部轨迹搜索计算开销大,性价比低于全局搜索。全局搜索策略如轨迹剪枝面临两大挑战:缩放后的流模型具有尖锐且低多样性的分布,限制候选空间;以及早期去噪阶段奖励模型存在偏差。为此,我们提出Repel(分词级多样性促进机制)和NARF(噪声感知奖励微调策略),分别提升样本多样性与早期阶段奖励准确性。两者协同实现更高效的测试时资源分配。整体方法命名为DOG-Trim:多样性增强、顺序对齐、全局流修剪。实验表明,在相同计算成本下,该方法相比无缩放基线提升约两倍性能,优于当前最佳方法。

原文摘要 · Abstract (English)

The performance of text-to-image diffusion models may be improved at test-time by scaling computation to search for a generated image that maximizes a given reward function. While existing trajectory level exploration methods improve the effectiveness of test-time scaling for standard diffusion models, they are largely incompatible with modern flow matching models, which use deterministic sampling. This imposes significant computational overhead on local trajectory search, making the trade-offs less favorable compared to global search. However, global search strategies like trajectory pruning face two critical challenges: the sharp, low-diversity distributions characteristic of scaled flow models that restrict the candidate search space, and the bias of reward models in the early denoising process. To overcome these limitations, we propose Repel, a token-level mechanism that encourages sample diversity, and NARF, a noise-aware reward fine-tuning strategy to obtain more accurate reward ranking at early denoising stages. Together, these promote more effective test-time scaling resource allocation. Overall, we name our pipeline as \textbf{DOG-Trim}: \textbf{D}iversity enhanced \textbf{O}rder aligned \textbf{G}lobal flow Trimming. The experiments demonstrate that, under the same compute cost, our approach achieves around twice the performance improvement relative to the scaling-free baseline compared to the best existing method. Github: https://github.com/TerrysLearning/DOGTrimTTS.

流匹配测试时扩展图像生成多样性优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。