40亿参数模型实现高效高分辨率图像生成与编辑
Mage-Flow: An Efficient Native-Resolution Foundation Model for Image Generation and Editing

- 采用轻量级编码器与原生分辨率扩散模型协同设计
- 1024×1024分辨率下生成仅需0.59秒,编辑1.02秒
- 适合需要低延迟交互的图像生成与编辑场景
大规模视觉生成模型能力日益强大,但训练、微调和部署成本高昂。我们提出Mage-Flow,一个40亿参数规模的紧凑生成模型栈,用于高效的文本到图像生成与基于指令的图像编辑。该模型栈由两个协同设计组件构成:轻量级高保真潜在编码器Mage-VAE,以及基于修正流匹配训练的原生分辨率多模态扩散变换器。Mage-VAE采用单步扩散式编码解码并引入锚点潜在正则化,在保持强公共VAE重建质量的同时,将分词开销降低一个数量级以上。结合原生分辨率打包与栈级CUDA核融合,该模型支持灵活分辨率训练,使端到端训练吞吐提升约2.5倍。在此基础上,我们构建了适用于生成与编辑的Base、RL对齐及Turbo系列变体。扩散-NFT提升提示遵循、文本渲染、美学质量与编辑保真度;少步蒸馏结合对抗感知引导生成4步快速推理的Turbo模型。尽管规模紧凑,Mage-Flow与Mage-Flow-Edit在标准生成与编辑基准上表现竞争力。更重要的是,Turbo变体使高分辨率生成与编辑可应用于交互场景:在单张NVIDIA A100 GPU上,1024²分辨率下生成耗时0.59秒,编辑耗时1.02秒,且内存占用小。结果表明,精心设计的编码器-主干-系统协同架构可在40亿参数模型中实现强大的高分辨率生成与编辑性能。
原文摘要 · Abstract (English)
Large-scale visual generators are increasingly capable but costly to train, fine-tune, and deploy. We introduce Mage-Flow, a compact 4B-scale generative stack for efficient text-to-image generation and instruction-based image editing. The stack is built from two co-designed components: Mage-VAE, a lightweight high-fidelity latent tokenizer, and a Native-Resolution Multimodal Diffusion Transformer trained with rectified flow matching. Mage-VAE uses one-step diffusion-style encoding and decoding with anchor-latent regularization, preserving the reconstruction quality of strong public VAEs while reducing tokenization cost by more than an order of magnitude. Together with native-resolution packing and stack-level CUDA kernel fusion, the stack supports flexible-resolution training and improves end-to-end training throughput by about $2.5\times$. Built on this foundation, we develop a complete model family with Base, RL-aligned, and Turbo variants for both generation and editing. Diffusion-NFT improves prompt following, text rendering, aesthetic quality, and editing fidelity, while few-step distillation with adversarial perceptual guidance produces 4-step Turbo models for low-latency inference. Despite its compact scale, Mage-Flow and Mage-Flow-Edit achieves competitive performance across standard generation and editing benchmarks. More importantly, the Turbo variants make high-resolution generation and editing practical for interactive use: at $1024^2$ resolution on a single NVIDIA A100 GPU, Mage-Flow-Turbo generates an image in 0.59s, and Mage-Flow-Edit-Turbo edits an image in 1.02s, while maintaining a small memory footprint. These results show that careful tokenizer--backbone--system co-design can deliver strong high-resolution generation and editing within an efficient 4B model family.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。