arXiv:2504.00010cs.LGcs.GR2025-04NeurIPS被引 20

用大模型分步规划构图,实现可控的图文生成与对象插入。

LayerCraft: Enhancing Text-to-Image Generation with CoT Reasoning and Layered Object Integration

  • 通过思维链推理分解场景,智能规划物体位置和布局。
  • 支持跨图像插入角色或道具,保持风格与身份一致。
  • 无需重训练,适合非专业人士批量编辑视觉内容。

文本到图像(T2I)生成已取得显著进展,但现有系统在空间构图、物体一致性及多步编辑方面仍缺乏直观控制。我们提出 LayerCraft,一个模块化框架,利用大语言模型(LLM)作为自主代理,协调结构化、分层的图像生成与编辑。LayerCraft 支持两大核心能力:(1) 从简单提示词出发,通过思维链(CoT)推理实现结构化生成,可分解场景、推理物体位置,并以可控、可解释的方式引导构图;(2) 分层对象集成,允许用户在不同图像或场景中插入并自定义对象(如角色或道具),同时保持身份、上下文和风格一致性。系统包含协调代理、用于 CoT 驱动布局规划的 ChainArchitect,以及使用现成 T2I 模型无缝编辑图像的 Object Integration Network(OIN),无需重新训练。通过批量拼贴编辑和叙事场景生成等应用,LayerCraft 使非专家能以极低人工成本迭代设计、定制和优化视觉内容。代码将发布于 https://github.com/PeterYYZhang/LayerCraft。

原文摘要 · Abstract (English)

Text-to-image (T2I) generation has made remarkable progress, yet existing systems still lack intuitive control over spatial composition, object consistency, and multi-step editing. We present $\textbf{LayerCraft}$, a modular framework that uses large language models (LLMs) as autonomous agents to orchestrate structured, layered image generation and editing. LayerCraft supports two key capabilities: (1) $\textit{structured generation}$ from simple prompts via chain-of-thought (CoT) reasoning, enabling it to decompose scenes, reason about object placement, and guide composition in a controllable, interpretable manner; and (2) $\textit{layered object integration}$, allowing users to insert and customize objects -- such as characters or props -- across diverse images or scenes while preserving identity, context, and style. The system comprises a coordinator agent, the $\textbf{ChainArchitect}$ for CoT-driven layout planning, and the $\textbf{Object Integration Network (OIN)}$ for seamless image editing using off-the-shelf T2I models without retraining. Through applications like batch collage editing and narrative scene generation, LayerCraft empowers non-experts to iteratively design, customize, and refine visual content with minimal manual effort. Code will be released at https://github.com/PeterYYZhang/LayerCraft.

文本生成图像分层编辑大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。