50亿参数模型实现顶尖图像生成与编辑能力,训练成本大幅降低。
DeepGen 1.0: A Lightweight Unified Multimodal Model for Advancing Image Generation and Editing
- 采用分层特征融合与可学习思考令牌,增强小模型语义理解。
- 仅用5000万样本训练,在多个评测中超越800亿参数模型。
- 开源代码权重,适合资源有限的研究者快速复现与应用。
当前统一多模态图像生成与编辑模型通常依赖超大规模参数(如>100亿),导致高昂的训练与部署成本。本文提出轻量级50亿参数的DeepGen 1.0,性能媲美甚至超越更大模型。为突破小型模型在语义理解与精细控制上的瓶颈,提出堆叠通道桥接(SCB)框架,从多个视觉语言模型层提取层次化特征,并与可学习的‘思考令牌’融合,为生成主干提供结构化、推理丰富的引导。设计三阶段数据驱动训练策略:(1) 基于大规模图文对与编辑三元组的对齐预训练,同步VLM与DiT表示;(2) 在高质量生成、编辑与推理任务混合数据上联合监督微调,培养全能力;(3) 采用MR-GRPO强化学习,结合多种奖励函数与监督信号,在提升生成质量与人类偏好对齐的同时,保持训练稳定并避免视觉伪影。尽管仅使用约5000万样本训练,DeepGen 1.0在多个基准上表现领先,于WISE上超越800亿参数的HunyuanImage 28%,在UniREditBench上超越270亿参数的Qwen-Image-Edit 37%。通过开源训练代码、权重与数据集,为统一多模态研究提供高效高性能替代方案。
原文摘要 · Abstract (English)
Current unified multimodal models for image generation and editing typically rely on massive parameter scales (e.g., >10B), entailing prohibitive training costs and deployment footprints. In this work, we present DeepGen 1.0, a lightweight 5B unified model that achieves comprehensive capabilities competitive with or surpassing much larger counterparts. To overcome the limitations of compact models in semantic understanding and fine-grained control, we introduce Stacked Channel Bridging (SCB), a deep alignment framework that extracts hierarchical features from multiple VLM layers and fuses them with learnable 'think tokens' to provide the generative backbone with structured, reasoning-rich guidance. We further design a data-centric training strategy spanning three progressive stages: (1) Alignment Pre-training on large-scale image-text pairs and editing triplets to synchronize VLM and DiT representations, (2) Joint Supervised Fine-tuning on a high-quality mixture of generation, editing, and reasoning tasks to foster omni-capabilities, and (3) Reinforcement Learning with MR-GRPO, which leverages a mixture of reward functions and supervision signals, resulting in substantial gains in generation quality and alignment with human preferences, while maintaining stable training progress and avoiding visual artifacts. Despite being trained on only ~50M samples, DeepGen 1.0 achieves leading performance across diverse benchmarks, surpassing the 80B HunyuanImage by 28% on WISE and the 27B Qwen-Image-Edit by 37% on UniREditBench. By open-sourcing our training code, weights, and datasets, we provide an efficient, high-performance alternative to democratize unified multimodal research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。