arXiv:2512.15603cs.CV2025-12被引 27

将图像分解为可独立编辑的图层,实现无副作用的一致性修改。

Qwen-Image-Layered: Towards Inherent Editability via Layer Decomposition

  • 通过可变层数的扩散模型,将单张图片拆解为语义分离的RGBA图层。
  • 在自建多图层数据集上训练,分解质量显著优于现有方法。
  • 适合需要精细可控编辑的设计师、内容创作者使用。

当前视觉生成模型在图像编辑时常因位图图像内容高度耦合而难以保持一致性。与之相对,专业设计工具采用分层表示,支持独立编辑并维持整体一致性。受此启发,我们提出Qwen-Image-Layered,一种端到端扩散模型,可将单张RGB图像分解为多个语义解耦的RGBA图层,实现固有的可编辑性:每个图层可独立操作而不影响其他内容。为支持可变长度分解,引入三个核心组件:(1) RGBA-VAE,统一RGB与RGBA图像的潜在表示;(2) VLD-MMDiT(可变层数分解MMDiT)架构,能处理不同数量的图像图层;(3) 多阶段训练策略,将预训练图像生成模型适配为多图层分解器。此外,针对高质量多图层训练数据稀缺问题,构建了从Photoshop文档(PSD)中提取并标注多图层图像的数据管道。实验表明,该方法在分解质量上显著超越现有方法,确立了持续一致图像编辑的新范式。代码与模型已开源。

原文摘要 · Abstract (English)

Recent visual generative models often struggle with consistency during image editing due to the entangled nature of raster images, where all visual content is fused into a single canvas. In contrast, professional design tools employ layered representations, allowing isolated edits while preserving consistency. Motivated by this, we propose \textbf{Qwen-Image-Layered}, an end-to-end diffusion model that decomposes a single RGB image into multiple semantically disentangled RGBA layers, enabling \textbf{inherent editability}, where each RGBA layer can be independently manipulated without affecting other content. To support variable-length decomposition, we introduce three key components: (1) an RGBA-VAE to unify the latent representations of RGB and RGBA images; (2) a VLD-MMDiT (Variable Layers Decomposition MMDiT) architecture capable of decomposing a variable number of image layers; and (3) a Multi-stage Training strategy to adapt a pretrained image generation model into a multilayer image decomposer. Furthermore, to address the scarcity of high-quality multilayer training images, we build a pipeline to extract and annotate multilayer images from Photoshop documents (PSD). Experiments demonstrate that our method significantly surpasses existing approaches in decomposition quality and establishes a new paradigm for consistent image editing. Our code and models are released on \href{https://github.com/QwenLM/Qwen-Image-Layered}{https://github.com/QwenLM/Qwen-Image-Layered}

图像编辑分层生成扩散模型可编辑性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。