arXiv:2603.28713cs.CV2026-03被引 3

0.39B参数模型实现手机端图像生成与编辑统一部署

DreamLite: A Lightweight On-Device Unified Model for Image Generation and Editing

  • 用轻量U-Net+潜空间拼接实现生成与编辑统一
  • 1024×1024图像生成/编辑<1秒,性能超现有移动端模型
  • 首次在手机上实现生成与编辑一体化,适合移动端应用

扩散模型在文本到图像生成和文本引导图像编辑方面取得了显著进展,但通常参数量达数十亿,导致延迟高、部署困难。现有移动端扩散模型多仅支持生成任务,缺乏编辑能力。本文提出DreamLite,一个0.39B参数的轻量级统一模型,可在单个网络中同时支持生成与编辑。基于剪枝后的移动U-Net主干,通过潜空间内的上下文拼接统一条件输入:生成任务使用(目标|空白)配置,编辑任务使用(目标|源图)配置。为稳定训练,引入任务渐进式联合预训练策略,依次优化生成、编辑与联合任务。经高质量SFT与强化学习微调后,DreamLite在GenEval(0.72)与ImgEdit(4.11)上均优于现有移动端模型,并保持与部分服务器端模型竞争力。通过步骤蒸馏,将去噪过程压缩至4步,在小米14手机上实现1024×1024图像生成或编辑<1秒。据我们所知,DreamLite是首个支持生成与编辑统一的移动端扩散模型。

原文摘要 · Abstract (English)

Diffusion models have made significant progress in both text-to-image (T2I) generation and text-guided image editing. However, these models are typically built with billions of parameters, leading to high latency and increased deployment challenges. While on-device diffusion models improve efficiency, they largely focus on T2I generation and lack support for image editing. In this paper, we propose DreamLite, a compact unified on-device diffusion model (0.39B) that supports both T2I generation and text-guided image editing within a single network. DreamLite is built on a pruned mobile U-Net backbone and unifies conditioning through in-context spatial concatenation in the latent space. It concatenates images horizontally as input, using a (target | blank) configuration for generation tasks and (target | source) for editing tasks. To stabilize the training of this compact model, we introduce a task-progressive joint pretraining strategy that sequentially targets T2I, editing, and joint tasks. After high-quality SFT and reinforcement learning, DreamLite achieves GenEval (0.72) for image generation and ImgEdit (4.11) for image editing, outperforming existing on-device models and remaining competitive with several server-side models. By employing step distillation, we further reduce denoising processing to just 4 steps, enabling our DreamLite could generate or edit a 1024 x 1024 image in less than 1s on a Xiaomi 14 smartphone. To the best of our knowledge, DreamLite is the first unified on-device diffusion model that supports both image generation and image editing.

图像生成扩散模型轻量化移动端

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。