自进化路由系统让文生图模型又快又准,无需人工标注。
OctoT2I: A Self-Evolving Agentic Text-to-Image Router

- 用自进化机制自动发现工具能力边界,动态选最优模型
- 在生成质量持平的情况下,推理速度提升90.3%,能效增56.6%
- 适合追求高效生成的工业级应用与资源受限场景
文本到图像(T2I)模型从大模型到轻量实时模型快速发展,但单一模型扩展已面临边际效益递减。现有代理式T2I方法存在三大问题:依赖昂贵的人工先验或标注、决策路径僵化、忽视推理效率。为此,我们提出OctoT2I,一种将生成质量与推理效率联合优化的新框架。该框架采用有状态、多轮路由策略,基于知识与记忆动态选择最适工具。其核心是全新自进化机制,无需人工监督,首先自主定义基础概念维度(如风格、色彩、数量),再通过迭代“提出—求解—评估—学习”(PSEL)循环智能探索组合,高效挖掘各工具的能力边界,实现无外部指导的持续优化。大量实验表明,OctoT2I在GenEval上达0.96得分,相较领先基线Flow-GRPO,推理速度提升90.3%,能效提升56.6%,在性能与效率间取得卓越平衡。代码与模型将公开。
原文摘要 · Abstract (English)
The explosive growth of Text-to-Image (T2I) models, from large-scale versions to lightweight, real-time ones, now faces diminishing marginal returns from single-model scaling. Agentic T2I methods emerged to alleviate this bottleneck by using multiple models. However, existing agentic T2I methods suffer from three key challenges: reliance on expensive handcrafted priors or human annotations, rigid single-path decision mechanisms, and a neglect of inference efficiency. To address these challenges, we introduce OctoT2I, a novel agentic framework that reformulates the T2I task as a joint optimization of generation quality and inference efficiency. OctoT2I implements a stateful, multi-round routing strategy that adaptively selects the most suitable tool based on its knowledge and memory. This strategy is enabled by a knowledge base built from scratch by our novel Self-Evolving Mechanism. This mechanism, which requires no human supervision, first autonomously defines foundational Conceptual Dimensions (eg, style, color, count) and then intelligently explores their combinations via an iterative" Propose--Solve--Evaluate--Learn"(PSEL) loop. The PSEL loop efficiently discovers each tool's capability frontier, driving continuous improvement without external guidance. Extensive experiments demonstrate that OctoT2I achieves competitive performance (0.96) on GenEval while delivering a 90.3% inference speedup and a 56.6% energy-efficiency gain over the leading baseline (Flow-GRPO), striking an exceptional balance between performance and efficiency. Code and models will be made available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。