arXiv:2603.12829cs.CV2026-03中稿 · CVPR被引 3

多智能体对话框架提升复杂图像生成中的物体组合与属性保持能力。

coDrawAgents: A Multi-Agent Dialogue Framework for Compositional Image Generation

  • 四智能体协作:解析提示、分步规划布局、验证空间一致性、逐步绘图。
  • 在GenEval和DPG-Bench上显著提升图像与文本对齐度、空间准确性及属性绑定率。
  • 适合需要高精度复杂场景生成的研究者与开发者使用。

文本到图像生成已迅速发展,但现有模型在复杂场景中仍难以准确组合多个对象并保持其属性。我们提出coDrawAgents,一个交互式多智能体对话框架,包含四个专用智能体:解读器、规划器、检查器和绘图器,协同提升组合生成效果。解读器动态决定采用直接文本到图像路径或布局感知的多智能体流程;在布局感知模式下,将提示解析为富含属性的对象描述,按语义显著性排序,并将同优先级对象分组联合生成。规划器基于分解-聚合策略,逐次为同优先级对象提出布局,决策始终基于画布的动态视觉上下文。检查器引入显式纠错机制,验证空间一致性与属性对齐,在渲染前修正布局。绘图器逐步合成图像,将新规划对象融入画布,为后续迭代提供更丰富的上下文。该框架有效解决布局复杂度高、规划缺乏视觉上下文依赖、缺乏显式纠错三大挑战。在GenEval和DPG-Bench基准上的大量实验表明,coDrawAgents在文本-图像对齐、空间准确性及属性绑定方面显著优于现有方法。

原文摘要 · Abstract (English)

Text-to-image generation has advanced rapidly, but existing models still struggle with faithfully composing multiple objects and preserving their attributes in complex scenes. We propose coDrawAgents, an interactive multi-agent dialogue framework with four specialized agents: Interpreter, Planner, Checker, and Painter that collaborate to improve compositional generation. The Interpreter adaptively decides between a direct text-to-image pathway and a layout-aware multi-agent process. In the layout-aware mode, it parses the prompt into attribute-rich object descriptors, ranks them by semantic salience, and groups objects with the same semantic priority level for joint generation. Guided by the Interpreter, the Planner adopts a divide-and-conquer strategy, incrementally proposing layouts for objects with the same semantic priority level while grounding decisions in the evolving visual context of the canvas. The Checker introduces an explicit error-correction mechanism by validating spatial consistency and attribute alignment, and refining layouts before they are rendered. Finally, the Painter synthesizes the image step by step, incorporating newly planned objects into the canvas to provide richer context for subsequent iterations. Together, these agents address three key challenges: reducing layout complexity, grounding planning in visual context, and enabling explicit error correction. Extensive experiments on benchmarks GenEval and DPG-Bench demonstrate that coDrawAgents substantially improves text-image alignment, spatial accuracy, and attribute binding compared to existing methods.

图像生成多智能体文本到图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。