arXiv:2604.12163cs.CV2026-04被引 5

用稀疏专家模型实现高效高质图像生成,仅激活20亿参数却媲美顶级模型。

Nucleus-Image: Sparse MoE for Image Generation

论文配图:Nucleus-Image: Sparse MoE for Image Generation
图 1 · 摘自论文原文
  • 采用稀疏专家混合架构,每层64个专家,总容量170亿参数。
  • 仅激活约20亿参数/次前向传播,在多个评测中超越或持平领先模型。
  • 全开源训练方案,无强化学习或人工调优,适合追求高效生成的研究者。

我们提出Nucleus-Image,一种文本到图像生成模型,通过稀疏专家混合(MoE)扩散Transformer架构,在质量与效率之间建立新的帕累托前沿。该模型在GenEval、DPG-Bench和OneIG-Bench上表现媲美或超过领先模型,每次前向传播仅激活约20亿参数。模型采用64个路由专家的架构,总容量达170亿参数,并通过专家选择路由机制实现高效扩展。为提升推理效率,架构去除了文本标记输入,采用联合注意力机制实现跨时间步的文本键值共享。针对时间步调制下的路由稳定性问题,引入解耦路由设计,分离时间步感知的专家分配与时间步条件的专家计算。训练数据来自15亿高质量图文对,覆盖7亿唯一图像,经多阶段过滤、去重、美学分级与标题优化构建。训练采用渐进式分辨率流程(256→512→1024),每阶段结合多宽高比分桶与专家容量因子逐步稀疏化。采用Muon优化器并公开专为带时间步调制的扩散模型设计的参数分组方案。实验表明,稀疏MoE扩展是实现高质量图像生成的有效路径,以极低的推理成本达到远超自身激活参数规模的性能。所有结果均无需后训练优化:无强化学习、无直接偏好优化、无人工偏好调优。我们开源完整训练方案,使Nucleus-Image成为首个在此质量水平下完全开源的MoE扩散模型。

原文摘要 · Abstract (English)

We present Nucleus-Image, a text-to-image generation model that establishes a new Pareto frontier in quality-versus-efficiency by matching or exceeding leading models on GenEval, DPG-Bench, and OneIG-Bench while activating only approximately 2B parameters per forward pass. Nucleus-Image employs a sparse mixture-of-experts (MoE) diffusion transformer architecture with Expert-Choice Routing that scales total model capacity to 17B parameters across 64 routed experts per layer. We adopt a streamlined architecture optimized for inference efficiency by excluding text tokens from the transformer backbone entirely and using joint attention that enables text KV sharing across timesteps. To improve routing stability when using timestep modulation, we introduce a decoupled routing design that separates timestep-aware expert assignment from timestep-conditioned expert computation. We construct a large-scale training corpus of 1.5B high-quality training pairs spanning 700M unique images through multi-stage filtering, deduplication, aesthetic tiering, and caption curation. Training follows a progressive resolution curriculum (256 to 512 to 1024) with multi-aspect-ratio bucketing at every stage, coupled with progressive sparsification of the expert capacity factor. We adopt the Muon optimizer and share our parameter grouping recipe tailored for diffusion models with timestep modulation. Nucleus-Image demonstrates that sparse MoE scaling is a highly effective path to high-quality image generation, reaching the performance of models with significantly larger active parameter budgets at a fraction of the inference cost. These results are achieved without post-training optimization of any kind: no reinforcement learning, no direct preference optimization, and no human preference tuning. We release the training recipe, making Nucleus-Image the first fully open-source MoE diffusion model at this quality.

图像生成稀疏专家扩散模型高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。