让AI生成图像像设计师一样用分层结构,可编辑可复用。
UniWorld-Design: From Pixel Generation to Layer-Native Design

- 用语义RGBA层替代像素,实现可理解可编辑的图像生成
- 在Crello数据集上层间误差降37%,透明度匹配提升34%
- 支持指令式分层操作,适合需要精细控制的创作场景
我们提出UniWorld-Design,将图像生成从平面像素合成转变为结构化视觉构图,以语义RGBA层为生成、理解与编辑的基本单元。核心观点是:像素决定图像如何渲染,而层决定图像如何创建、理解与编辑。如同人类设计师通过分层工作,UniWorld-Design赋予多模态生成模型原生分层设计空间。该框架包含两个模型:文本到RGBA(T2RGBA)模型直接从文本生成独立的RGBA资产;图像到层(I2L)模型基于完成图像、全局指令和每层提示,联合生成有序且完整的语义RGBA层。其指令接口支持顶层分解、递归分解与目标提取,使分层成为可指令操作的代理编辑方式。由于I2L学习的是完整语义对象而非可见像素划分,其层在移动或移除后仍可用。在Crello基准测试中,I2L将每层RGB L1误差降低37%,在Alpha Soft IoU上相较Qwen-Image-Layered提升34%。T2RGBA则取得最高CLIP Score,优于LayerDiffuse与OmniAlpha。
原文摘要 · Abstract (English)
We introduce UniWorld-Design, a framework that redefines image generation from flat pixel synthesis to structured visual composition, with semantic RGBA layers as the atomic units of generation, understanding, and editing. Our key insight is that pixels define how an image is rendered, whereas layers define how an image is created, understood, and edited. Just as human designers create and manipulate visual content through layers rather than raw pixels, UniWorld-Design equips multimodal generative models with a layer-native design space. UniWorld-Design comprises two models. The Text-to-RGBA (T2RGBA) model generates standalone RGBA assets directly from text. The Image-to-Layer (I2L) model conditions on a finished image, a global instruction and per-layer prompts, and jointly produces ordered, complete semantic RGBA layers. Its instruction interface supports top-level decomposition, recursive decomposition and targeted extraction, making layering an instruction-addressable operation for agentic editing. Because I2L learns complete semantic objects rather than visible-pixel partitions, its layers stay usable when moved or removed. On the Crello benchmark, I2L reduces per-layer RGB L1 error by 37% and achieves a 34% relative improvement in Alpha Soft IoU over Qwen-Image-Layered. Separately, T2RGBA achieves the highest CLIP Score, outperforming LayerDiffuse and OmniAlpha.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。