arXiv:2603.05769cs.CV2026-03中稿 · CVPR被引 9

无需训练即可精准控制图像区域布局与遮挡顺序。

Layer-wise Instance Binding for Regional and Occlusion Control in Text-to-Image Diffusion Transformers

  • 按层绑定实例,早期重构潜空间实现布局控制
  • 支持可编辑修改,如更换对象或调整可见顺序
  • 无需训练,适配多种扩散模型,适合创意设计

文本到图像生成中的区域指令布局控制具有重要实用价值,但现有方法存在局限:(i) 基于训练的方法继承数据偏见且常降低图像质量;(ii) 当前技术难以处理遮挡顺序,限制真实应用。为此,我们提出 LayerBind。通过将区域生成建模为独立层级并绑定生成过程,该方法实现了精确的区域与遮挡可控性。核心观察是空间布局与遮挡关系在去噪初期即已确立,因此仅需重构早期潜空间即可改变最终输出。方法分为两阶段:(1) 层级实例初始化:利用多模态联合注意力的上下文共享机制,创建每个实例的独立分支,分别关注自身区域并锚定共享背景;在指定早期步骤,按层级顺序融合分支以形成预设布局的统一潜变量;(2) 层级语义护理:通过层级注意力增强强化区域细节并维持遮挡顺序,采用序列化层级注意力路径与标准全局路径并行,更新结果由层级透明度调度器组合。LayerBind 为无训练、即插即用的控制器,适用于各类扩散变压器。除生成外,还支持可编辑工作流,灵活修改实例或调整可见顺序。定性和定量实验均验证其有效性,展现出显著的创意应用潜力。

原文摘要 · Abstract (English)

Region-instructed layout control in text-to-image generation is highly practical, yet existing methods suffer from limitations: (i) training-based approaches inherit data bias and often degrade image quality, and (ii) current techniques struggle with occlusion order, limiting real-world usability. To address these issues, we propose LayerBind. By modeling regional generation as distinct layers and binding them during the generation, our method enables precise regional and occlusion controllability. Our motivation stems from the observation that spatial layout and occlusion are established at a very early denoising stage, suggesting that rearranging the early latent structure is sufficient to modify the final output. Building on this, we structure the scheme into two phases: instance initialization and subsequent semantic nursing. (1) First, leveraging the contextual sharing mechanism in multimodal joint attention, Layer-wise Instance Initialization creates per-instance branches that attend to their own regions while anchoring to the shared background. At a designated early step, these branches are fused according to the layer order to form a unified latent with a pre-established layout. (2) Then, Layer-wise Semantic Nursing reinforces regional details and maintains the occlusion order via a layer-wise attention enhancement. Specifically, a sequential layered attention path operates alongside the standard global path, with updates composited under a layer-transparency scheduler. LayerBind is training-free and plug-and-play, serving as a regional and occlusion controller across Diffusion Transformers. Beyond generation, it natively supports editable workflows, allowing for flexible modifications like changing instances or rearranging visible orders. Both qualitative and quantitative results demonstrate LayerBind's effectiveness, highlighting its strong potential for creative applications.

图像生成扩散模型可控生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。