arXiv:2605.21573cs.CV2026-05被引 1

38亿参数模型性能超60亿参数模型,训练效率提升80%以上。

Lens: Rethinking Training Efficiency for Foundational Text-to-Image Models

论文配图:Lens: Rethinking Training Efficiency for Foundational Text-to-Image Models
图 1 · 摘自论文原文
  • 用8亿张密集标注图文对和多分辨率图像构建高信息密度数据集。
  • 在19.3%的训练算力下达成领先性能,生成速度达3.15秒/1024×1024图。
  • 适合资源有限但需高效生成与多语言支持的开发者或部署场景。

我们提出Lens,一个38亿参数的文生图模型,在多个基准测试中性能媲美甚至超越参数量超过60亿的顶尖模型,同时显著降低训练算力需求。例如,Lens仅需Z-Image约19.3%的训练计算量。其高效性源于两项关键策略:一是利用由GPT-4.1生成的8亿条密集描述(平均约109词)的图文对构成Lens-800M数据集,提升语义监督密度;二是通过混合多分辨率与多样长宽比图像构建训练批次,扩大每步优化的视觉覆盖范围。二是通过架构设计加速收敛,采用语义型VAE获得更优潜在表示,并使用强语言编码器实现从仅英语训练数据中获得多语言泛化能力。预训练后,采用基于分类体系的强化学习(Lens-RL-8K)与结构化评分规则抑制伪影、提升画质;引入无需训练的系统提示搜索推理模块以更好对齐用户意图;并采用蒸馏加速实现4步生成。得益于高效训练与系统优化,Lens可支持1:2至2:1任意长宽比及最高1440²分辨率,支持多种常用语言。由于模型紧凑,单块NVIDIA H100 GPU上生成1024²图像仅需3.15秒,其蒸馏加速版4步生成仅耗时0.84秒。

原文摘要 · Abstract (English)

We introduce Lens, a 3.8B-parameter T2I model that achieves performance competitive with, and in several cases surpassing, state-of-the-art models with more than 6B parameters across various benchmarks, while requiring significantly less training compute. For example, Lens requires only about 19.3% of the training compute used by Z-Image. The training efficiency of Lens stems from two key strategies beyond its compact model size. First, we maximize data information density per training batch by (i) training on Lens-800M, a dataset of 800M densely captioned image-text pairs whose captions are generated by GPT-4.1 and contain approximately 109 words on average, providing richer semantic supervision than conventional short captions, and (ii) constructing each batch from images with multiple resolutions and diverse aspect ratios, thereby enlarging the effective visual coverage of each optimization step. Second, we improve convergence speed through careful architectural choices, including adopting a semantic VAE that provides better latent representations and employing a strong language encoder that accelerates optimization while enabling multilingual generalization from English-only training data. After pre-training, we apply RL with taxonomy-driven prompts (Lens-RL-8K) and structured reward rubrics to suppress artifacts and improve visual quality, a reasoner module with training-free system prompt search to better align user requests with the model, and distillation-based acceleration for 4-step inference. Through efficient training and systematic optimization, Lens generalizes to arbitrary aspect ratios from 1:2 to 2:1 and resolutions up to 1440^2, and supports prompts in several commonly used languages. Thanks to its compact size, Lens generates a 1024^2 image in 3.15 seconds on a single NVIDIA H100 GPU, while its distilled turbo version performs 4-step generation in 0.84 seconds.

文生图训练效率小模型多语言

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。