arXiv:2601.15286cs.CVcs.AI2026-01被引 4

通过迭代自修正提升复杂图文生成的准确性

Iterative Refinement Improves Compositional Image Generation

  • 用视觉语言模型作批评者,逐步优化图像生成
  • 在多个基准上提升12.5%以上,最高达16.9%
  • 适合需要精准组合描述的图像生成场景

文本到图像(T2I)模型虽已取得显著进展,但在处理需同时包含多个物体、关系与属性的复杂提示时仍存在困难。现有推理阶段方法如并行采样或增加去噪步骤,虽能改善提示对齐,但在丰富组合场景中仍不足。受大语言模型链式思考成功的启发,我们提出一种迭代测试时策略:让T2I模型在多步中逐步优化生成结果,由视觉语言模型作为反馈批评者参与循环。该方法简单,无需外部工具或先验知识,可灵活适配多种图像生成器与视觉语言模型。实验显示,在多个基准上均有稳定提升:ConceptMix(k=7)全正确率提高16.9%,T2I-CompBench(3D-Spatial类别)提升13.8%,Visual Jenga场景分解提升12.5%,均优于计算量匹配的并行采样。此外,人类评估中58.7%偏好本方法,优于41.3%的基线。结果表明,迭代自纠正是一种广泛适用的组合图像生成原则。代码与可视化见 https://iterative-img-gen.github.io/

原文摘要 · Abstract (English)

Text-to-image (T2I) models have achieved remarkable progress, yet they continue to struggle with complex prompts that require simultaneously handling multiple objects, relations, and attributes. Existing inference-time strategies, such as parallel sampling with verifiers or simply increasing denoising steps, can improve prompt alignment but remain inadequate for richly compositional settings where many constraints must be satisfied. Inspired by the success of chain-of-thought reasoning in large language models, we propose an iterative test-time strategy in which a T2I model progressively refines its generations across multiple steps, guided by feedback from a vision-language model as the critic in the loop. Our approach is simple, requires no external tools or priors, and can be flexibly applied to a wide range of image generators and vision-language models. Empirically, we demonstrate consistent gains on image generation across benchmarks: a 16.9% improvement in all-correct rate on ConceptMix (k=7), a 13.8% improvement on T2I-CompBench (3D-Spatial category) and a 12.5% improvement on Visual Jenga scene decomposition compared to compute-matched parallel sampling. Beyond quantitative gains, iterative refinement produces more faithful generations by decomposing complex prompts into sequential corrections, with human evaluators preferring our method 58.7% of the time over 41.3% for the parallel baseline. Together, these findings highlight iterative self-correction as a broadly applicable principle for compositional image generation. Results and visualizations are available at https://iterative-img-gen.github.io/

图像生成迭代优化组合性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。