arXiv:2605.27235cs.CV2026-05

200亿参数模型实现可编辑的分层图像生成,支持跨任务统一建模与超快推理。

MRT: Masked Region Transformer for Layered Image Generation and Editing at Scale

论文配图:MRT: Masked Region Transformer for Layered Image Generation and Editing at Scale
图 1 · 摘自论文原文
  • 基于掩码区域扩散框架,统一文本/图像/分层生成任务,支持逐层编辑。
  • 引入溢出感知画布层,实现超出可视区域的完整可编辑图层,解决边界不一致问题。
  • 通过蒸馏实现8步实时生成,速度比竞品快10-100倍,显存降低50%-90%。

分层图像生成与编辑是支持逐层复用、编辑和组合生成视觉内容的核心能力,类比于自然语言中的词级编辑。尽管重要,该领域在大规模上仍研究不足。为此,我们提出MRT——一个200亿参数的掩码区域扩散模型,专为多层透明图像生成与编辑设计,训练数据包含超过1000万个多语言设计样本,覆盖多样纵横比与文本提示。为充分挖掘规模潜力,我们提出两项关键技术:第一,将文本到图层、图像到图层、图层到图层三类任务统一于共享的掩码区域扩散框架中,通过选择性标记实现灵活的分层生成与编辑;第二,引入溢出感知画布层,处理边界不一致问题,支持半透明背景合成,实现超出可见画布范围的完整可编辑图层。此外,采用扩散蒸馏技术,实现8步实时多层生成,质量损失极小。大量实验表明,本框架在三项任务上均显著优于现有最先进方法,包括多种商业系统,建立了新的多层透明图像生成基准。特别地,用户研究显示,模型在图像到图层质量上显著超越同期的Qwen-Image-Layered模型,同时推理速度提升10-100倍,图像到图层推理期间激活显存消耗降低50%-90%。

原文摘要 · Abstract (English)

Layered image generation and editing is a fundamental capability that enables layer-wise reuse, editing, and composition of generated visual content, analogous to word-level editing in natural language. Despite its importance, this remains an underexplored area at scale. To address this gap, we present MRT, a 20B-parameter masked region diffusion model tailored for multi-layer transparent image generation and editing, trained on over 10M multilingual design samples spanning diverse aspect ratios and textual prompts. To fully leverage this scale, we make two key technical contributions. First, we unify three complementary tasks including text-to-layers, image-to-layers, and layers-to-layers within a shared masked region diffusion framework, where selective token masking enables flexible layer-wise generation and editing. Second, to enable overflow layer generation, we introduce an overflow-aware canvas layer that handles boundary inconsistencies and supports semi-transparent background synthesis, enabling complete editable layers extending beyond visible canvas boundaries. Additionally, we apply diffusion distillation to achieve 8-step, real-time multi-layer generation with minimal quality degradation. Extensive experiments demonstrate that our framework substantially outperforms prior state-of-the-art approaches, including various commercial systems, across all three tasks, establishing a new benchmark for multi-layer transparent image generation. Notably, our model significantly outperforms the concurrent Qwen-Image-Layered model in image-to-layers quality according to user-study results, while achieving 10-100\times faster inference and reducing activation GPU memory consumption by 50-90\% during image-to-layer inference.

分层生成扩散模型图像编辑实时推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。