让图像生成过程像人类画画一样可监控、可控制。
Chain-of-Image Generation: Toward Monitorable and Controllable Image Generation
- 用大模型拆解复杂提示为一步步指令,逐步生成图像。
- 新指标验证每步清晰度与对最终图像的影响。
- 适合需要可控性和透明度的AI作图场景。
当前顶尖图像生成模型虽视觉效果出色,但其内部生成过程如黑箱一般难以观测和干预,影响可靠性与安全性。为此,我们提出链式图像生成(Chain-of-Image Generation, CoIG)框架,将图像生成重构为类似人类创作的艺术流程:利用大语言模型将复杂提示分解为一系列简单、分步的指令,图像生成模型按此计划逐步生成并编辑图像,每一步聚焦单一语义实体,实现直接监控。我们引入两个新指标:CoIG可读性,评估每步输出的清晰度;因果相关性,量化每步对最终结果的影响。实验表明,CoIG显著提升生成过程的可监控性,同时在组合鲁棒性上优于主流基线模型。该框架具备模型无关性,可兼容任意图像生成模型。
原文摘要 · Abstract (English)
While state-of-the-art image generation models achieve remarkable visual quality, their internal generative processes remain a "black box." This opacity limits human observation and intervention, and poses a barrier to ensuring model reliability, safety, and control. Furthermore, their non-human-like workflows make them difficult for human observers to interpret. To address this, we introduce the Chain-of-Image Generation (CoIG) framework, which reframes image generation as a sequential, semantic process analogous to how humans create art. Similar to the advantages in monitorability and performance that Chain-of-Thought (CoT) brought to large language models (LLMs), CoIG can produce equivalent benefits in text-to-image generation. CoIG utilizes an LLM to decompose a complex prompt into a sequence of simple, step-by-step instructions. The image generation model then executes this plan by progressively generating and editing the image. Each step focuses on a single semantic entity, enabling direct monitoring. We formally assess this property using two novel metrics: CoIG Readability, which evaluates the clarity of each intermediate step via its corresponding output; and Causal Relevance, which quantifies the impact of each procedural step on the final generated image. We further show that our framework mitigates entity collapse by decomposing the complex generation task into simple subproblems, analogous to the procedural reasoning employed by CoT. Our experimental results indicate that CoIG substantially enhances quantitative monitorability while achieving competitive compositional robustness compared to established baseline models. The framework is model-agnostic and can be integrated with any image generation model.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。