让图像生成智能体通过工具协作自我进化,提升复杂任务表现。
GenEvolve: Self-Evolving Image Generation Agents via Tool-Orchestrated Visual Experience Distillation

- 用工具编排生成轨迹,动态整合参考与提示
- 通过最优最差轨迹对比提炼结构化视觉经验,提升生成质量
- 适合需要持续优化、复杂场景生成的研究与应用
开放域图像生成已超越简单提示到图像的范式。高质量生成需结合模型内生能力与外部资源。随着需求日益多样和复杂,我们提出GenEvolve——一种基于工具编排视觉经验蒸馏的自进化框架。每个生成尝试被建模为工具协调的轨迹,智能体收集证据、选择参考、调用生成技能,并组合成提示-参考程序。不同于依赖图像级标量奖励的现有方法,GenEvolve对同一请求的多条轨迹进行比较,将最优与最差差异抽象为结构化视觉经验,仅提供给特权教师分支。受在线策略自蒸馏启发,视觉经验蒸馏提供密集的词元级监督,帮助学生模型内化更优的搜索、知识激活、参考选择与提示构建。我们还构建了GenEvolve-Data与GenEvolve-Bench。在公开基准与GenEvolve-Bench上的实验表明,其性能显著优于强基线,达到当前图像生成框架的顶尖水平。
原文摘要 · Abstract (English)
Open-ended image generation is no longer a simple prompt-to-image problem. High-quality generation often requires an agent to combine a model's internal generative ability with external resources. As requests become more diverse and demanding, we aim to develop a general image-generation agent that can self-evolve through trajectories and use tools more effectively across varied generation challenges. To this end, we propose GenEvolve, a self-evolving framework based on Tool-Orchestrated Visual Experience Distillation. In GenEvolve, each generation attempt is modeled as a tool-orchestrated trajectory, where the agent gathers evidence, selects references, invokes generation skills, and composes them into a prompt-reference program. Unlike existing agentic generation methods that mainly rely on image-level scalar rewards, GenEvolve compares multiple trajectories for the same request and abstracts best-worst differences into structured visual experience, provided only to a privileged teacher branch. Inspired by on-policy self-distillation, Visual Experience Distillation provides dense token-level supervision, helping the student internalize better search, knowledge activation, reference selection, and prompt construction. We further construct GenEvolve-Data and GenEvolve-Bench. Experiments on public benchmarks and GenEvolve-Bench show substantial gains over strong baselines, achieving state-of-the-art performance among current image-generation frameworks. Our website is as follows: https://ephemeral182.github.io/GenEvolve/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。