arXiv:2510.07217cs.CVcs.AI2025-10EMNLP被引 6

用多智能体系统在生成时优化复杂提示,提升图文一致性。

GenPilot: A Multi-Agent System for Test-Time Prompt Optimization in Image Generation

  • 设计多智能体系统,动态分析错误并迭代优化提示文本。
  • 在DPG-bench和Geneval上分别提升16.9%和5.7%,显著改善生成质量。
  • 无需训练、可插拔,适合长提示与复杂场景的图像生成任务。

文本到图像生成虽取得显著进展,但准确解析复杂长提示仍具挑战,常导致语义不一致或细节缺失。现有方法如微调依赖模型且需训练,先前自动提示优化(APO)缺乏系统性错误分析与修正策略,可靠性不足。测试时缩放方法则固定提示,仅调整噪声或样本数,可解释性差。为此,我们提出一种直接作用于输入文本的灵活高效测试时提示优化策略,构建名为GenPilot的即插即用多智能体系统,融合错误分析、基于聚类的自适应探索、细粒度验证与记忆模块,实现迭代优化。该方法模型无关、可解释,适用于长而复杂的提示。我们总结常见错误模式与优化策略,推动进一步研究。在DPG-bench与Geneval上的实验表明,性能最高提升16.9%和5.7%,显著增强生成图像的图文一致性和结构连贯性。代码已开源。

原文摘要 · Abstract (English)

Text-to-image synthesis has made remarkable progress, yet accurately interpreting complex and lengthy prompts remains challenging, often resulting in semantic inconsistencies and missing details. Existing solutions, such as fine-tuning, are model-specific and require training, while prior automatic prompt optimization (APO) approaches typically lack systematic error analysis and refinement strategies, resulting in limited reliability and effectiveness. Meanwhile, test-time scaling methods operate on fixed prompts and on noise or sample numbers, limiting their interpretability and adaptability. To solve these, we introduce a flexible and efficient test-time prompt optimization strategy that operates directly on the input text. We propose a plug-and-play multi-agent system called GenPilot, integrating error analysis, clustering-based adaptive exploration, fine-grained verification, and a memory module for iterative optimization. Our approach is model-agnostic, interpretable, and well-suited for handling long and complex prompts. Simultaneously, we summarize the common patterns of errors and the refinement strategy, offering more experience and encouraging further exploration. Experiments on DPG-bench and Geneval with improvements of up to 16.9% and 5.7% demonstrate the strong capability of our methods in enhancing the text and image consistency and structural coherence of generated images, revealing the effectiveness of our test-time prompt optimization strategy. The code is available at https://github.com/27yw/GenPilot.

图像生成提示优化多智能体测试时

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。