arXiv:2606.01803cs.AI2026-06被引 2

自进化路由系统让文生图模型又快又准,无需人工标注。

OctoT2I: A Self-Evolving Agentic Text-to-Image Router

论文配图:OctoT2I: A Self-Evolving Agentic Text-to-Image Router
图 1 · 摘自论文原文
  • 用自进化机制自动发现工具能力边界,动态选最优模型
  • 在生成质量持平的情况下,推理速度提升90.3%,能效增56.6%
  • 适合追求高效生成的工业级应用与资源受限场景

文本到图像(T2I)模型从大模型到轻量实时模型快速发展,但单一模型扩展已面临边际效益递减。现有代理式T2I方法存在三大问题:依赖昂贵的人工先验或标注、决策路径僵化、忽视推理效率。为此,我们提出OctoT2I,一种将生成质量与推理效率联合优化的新框架。该框架采用有状态、多轮路由策略,基于知识与记忆动态选择最适工具。其核心是全新自进化机制,无需人工监督,首先自主定义基础概念维度(如风格、色彩、数量),再通过迭代“提出—求解—评估—学习”(PSEL)循环智能探索组合,高效挖掘各工具的能力边界,实现无外部指导的持续优化。大量实验表明,OctoT2I在GenEval上达0.96得分,相较领先基线Flow-GRPO,推理速度提升90.3%,能效提升56.6%,在性能与效率间取得卓越平衡。代码与模型将公开。

原文摘要 · Abstract (English)

The explosive growth of Text-to-Image (T2I) models, from large-scale versions to lightweight, real-time ones, now faces diminishing marginal returns from single-model scaling. Agentic T2I methods emerged to alleviate this bottleneck by using multiple models. However, existing agentic T2I methods suffer from three key challenges: reliance on expensive handcrafted priors or human annotations, rigid single-path decision mechanisms, and a neglect of inference efficiency. To address these challenges, we introduce OctoT2I, a novel agentic framework that reformulates the T2I task as a joint optimization of generation quality and inference efficiency. OctoT2I implements a stateful, multi-round routing strategy that adaptively selects the most suitable tool based on its knowledge and memory. This strategy is enabled by a knowledge base built from scratch by our novel Self-Evolving Mechanism. This mechanism, which requires no human supervision, first autonomously defines foundational Conceptual Dimensions (eg, style, color, count) and then intelligently explores their combinations via an iterative" Propose--Solve--Evaluate--Learn"(PSEL) loop. The PSEL loop efficiently discovers each tool's capability frontier, driving continuous improvement without external guidance. Extensive experiments demonstrate that OctoT2I achieves competitive performance (0.96) on GenEval while delivering a 90.3% inference speedup and a 56.6% energy-efficiency gain over the leading baseline (Flow-GRPO), striking an exceptional balance between performance and efficiency. Code and models will be made available.

文生图智能路由自进化高效生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。