arXiv:2502.14779cs.CV2025-02ICCV被引 11

将图像生成中的条件控制拆解为元素内与元素间,实现更灵活精准的多条件生成。

DC-ControlNet: Decoupling Inter- and Intra-Element Conditions in Image Generation with Diffusion Models

  • 分离元素内与元素间控制信号,构建分层条件系统
  • 支持用户自定义元素关系,准确处理遮挡与交互
  • 相比传统ControlNet提升多条件生成灵活性和精度

本文提出DC-ControlNet,一种用于多条件图像生成的高灵活性、高可控性框架。其核心思想是解耦控制条件,将全局控制转化为整合不同元素、内容与布局的分层系统,使用户能更灵活地组合各类条件,实现更高效精确的图像生成控制。现有基于ControlNet的模型仅依赖全局条件,影响整幅图像,缺乏对特定元素或区域的控制能力,导致灵活性不足且易产生条件误解。为此,我们设计了元素内控制器(Intra-Element Controller)以处理单个元素内的多种控制信号,精准描述对象的内容与布局特征;同时引入元素间控制器(Inter-Element Controller),基于用户定义的关系,准确建模多元素间的交互与遮挡。大量实验表明,DC-ControlNet在多条件控制的灵活性与精度上显著优于现有ControlNet模型及布局到图像生成模型。

原文摘要 · Abstract (English)

In this paper, we introduce DC (Decouple)-ControlNet, a highly flexible and precisely controllable framework for multi-condition image generation. The core idea behind DC-ControlNet is to decouple control conditions, transforming global control into a hierarchical system that integrates distinct elements, contents, and layouts. This enables users to mix these individual conditions with greater flexibility, leading to more efficient and accurate image generation control. Previous ControlNet-based models rely solely on global conditions, which affect the entire image and lack the ability of element- or region-specific control. This limitation reduces flexibility and can cause condition misunderstandings in multi-conditional image generation. To address these challenges, we propose both intra-element and Inter-element Controllers in DC-ControlNet. The Intra-Element Controller handles different types of control signals within individual elements, accurately describing the content and layout characteristics of the object. For interactions between elements, we introduce the Inter-Element Controller, which accurately handles multi-element interactions and occlusion based on user-defined relationships. Extensive evaluations show that DC-ControlNet significantly outperforms existing ControlNet models and Layout-to-Image generative models in terms of control flexibility and precision in multi-condition control. Our project website is available at: https://um-lab.github.io/DC-ControlNet/

扩散模型图像生成条件控制多元素交互

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。