arXiv:2606.11289cs.CV2026-06被引 1

公开可复现的文本生成图像模型训练配方,性能媲美顶尖闭源模型。

i1: A Simple and Fully Open Recipe for Strong Text-to-Image Models

论文配图:i1: A Simple and Fully Open Recipe for Strong Text-to-Image Models
图 1 · 摘自论文原文
  • 通过700万+TPU小时实验,验证数据混合与模型设计关键策略。
  • i1模型在5个基准上达领先水平,比现有开源模型平均高29.5%。
  • 全开源代码、数据与模型,助力可复现的视觉生成研究。

扩散模型持续推动文本到图像生成的发展。然而,当前进展难以归因于具体建模与数据选择:顶级开源权重模型缺乏充分消融实验,且未公开训练数据与完整训练细节。研究社区亟需全开源(权重、数据、代码)模型作为后续研究基础;但现有全开源模型性能仍显著落后于领先模型。本项目通过300余次受控实验(总计超700,000 TPU v6e小时),系统研究文本到图像扩散模型的训练与推理设计选择。实验揭示多项经验发现(如均衡加权是混合精选数据集的强默认策略)和简单有效决策(如增大文本编码器适配器可提升性能,参数增量极小)。基于这些洞察,我们使用公开数据训练出i1——一个30亿参数的文本到图像扩散模型。i1在五个代表性基准(GenEval、DPG、PRISM、CVTG-2K、LongText)上表现优异,且平均超越现有最佳全开源模型29.5个百分点。我们提供i1检查点、训练与推理代码及数据处理流程。研究成果与i1配方共同为未来文本到图像扩散模型的开放研究奠定实用基础。代码已开源:https://github.com/zlab-princeton/i1。

原文摘要 · Abstract (English)

Diffusion models have consistently driven progress in text-to-image generation. However, it is challenging to attribute recent progress to specific modeling and data choices: state-of-the-art open-weight models provide limited ablations, and do not disclose their training data and full training details. The research community needs fully open (weights, data, and code) models as a foundation for further research; yet existing fully open models still fall significantly short of leading models in performance. In this project, we conduct a systematic investigation of the modeling and data design choices in text-to-image diffusion training and inference with 300+ controlled experiments totaling 700K+ TPU v6e hours. Our experiments highlight several empirical findings (e.g., equal weighting is a strong default for mixing curated datasets) and simple design decisions (e.g., larger text encoder adapters improve performance with minimal added parameters) for training strong models. Guided by these insights, we train i1, a 3B-parameter text-to-image diffusion model using only publicly available datasets. i1 is competitive with leading models on five representative benchmarks (GenEval, DPG, PRISM, CVTG-2K, and LongText), and outperforms the best existing fully open model by 29.5 absolute percentage points on average. We provide the i1 checkpoints, training and inference code, and the data processing pipeline. Together, our findings and the i1 recipe establish a practical foundation for future open research in text-to-image diffusion models. Our code is available at https://github.com/zlab-princeton/i1.

文本生成图像扩散模型全开源可复现

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。